Jun 05 15:32:10.453967 ip-10-0-140-178 systemd[1]: Starting Kubernetes Kubelet... Jun 05 15:32:10.909523 ip-10-0-140-178 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:32:10.909523 ip-10-0-140-178 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 15:32:10.909523 ip-10-0-140-178 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:32:10.909523 ip-10-0-140-178 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 15:32:10.909523 ip-10-0-140-178 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:32:10.911450 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.911374 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 15:32:10.916237 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916222 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:32:10.916237 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916237 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916241 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916244 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916247 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916250 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916254 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916257 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916260 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916263 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916265 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916268 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916271 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916274 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916276 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916279 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916282 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916285 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916287 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916290 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:32:10.916300 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916292 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916302 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916306 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916309 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916312 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916315 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916319 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916322 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916324 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916327 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916329 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916332 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916335 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916337 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916340 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916342 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916345 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916347 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916349 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:32:10.916771 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916352 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916354 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916358 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916362 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916365 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916367 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916370 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916373 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916376 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916379 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916382 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916384 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916387 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916390 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916392 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916396 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916401 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916404 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916407 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:32:10.917228 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916410 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916413 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916416 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916419 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916421 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916425 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916428 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916430 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916433 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916435 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916438 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916440 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916442 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916445 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916448 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916450 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916453 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916455 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916458 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:32:10.917804 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916461 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916463 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916466 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916468 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916471 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916473 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916475 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916478 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916480 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916483 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916487 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916489 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916492 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916495 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916497 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916500 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916502 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916505 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916508 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916510 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:32:10.918582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916512 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.916515 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917240 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917247 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917250 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917253 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917256 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917259 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917262 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917264 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917267 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917271 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917273 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917276 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917279 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917281 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917284 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917286 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917289 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917292 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:32:10.919185 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917295 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917298 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917301 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917304 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917307 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917310 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917312 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917315 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917318 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917320 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917323 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917325 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917328 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917332 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917336 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917339 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917342 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917345 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917347 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:32:10.919700 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917350 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917352 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917355 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917359 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917362 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917366 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917369 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917372 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917374 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917377 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917380 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917383 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917386 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917388 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917392 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917395 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917398 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917402 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:32:10.920251 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917405 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917409 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917412 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917415 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917418 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917421 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917424 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917426 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917429 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917431 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917434 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917436 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917440 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917442 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917445 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917447 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917450 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917454 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917456 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917459 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917462 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:32:10.920709 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917464 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917467 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917469 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917472 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917474 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917477 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917480 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917483 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917486 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917489 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917492 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917495 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917497 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917500 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917503 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917505 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917507 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917510 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917513 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:32:10.921218 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917515 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917518 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917520 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.917523 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920406 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920417 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920421 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920424 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920427 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920430 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920434 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920437 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920439 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920442 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920444 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920447 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920450 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920452 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920455 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:32:10.921688 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920457 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920460 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920463 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920466 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920469 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920472 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920474 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920477 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920480 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920483 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920485 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920488 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920491 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920493 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920495 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920498 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920500 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920503 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920507 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920510 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:32:10.922148 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920512 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920515 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920517 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920520 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920523 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920525 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920527 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920530 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920533 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920535 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920538 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920540 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920542 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920545 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920548 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920550 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920553 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920556 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920558 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920560 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:32:10.922634 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920563 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920566 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920568 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920571 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920574 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920576 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920579 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920583 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920587 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920590 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920593 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920596 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920599 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920603 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920607 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920610 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920612 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920615 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920619 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:32:10.923176 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920635 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920638 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920641 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920643 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920645 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920648 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920650 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920653 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920656 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920658 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920661 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920663 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920666 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920668 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920671 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920674 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920676 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920679 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920682 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920684 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:32:10.923646 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920687 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920690 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920692 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920695 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.920697 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920768 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920774 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920780 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920784 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920788 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920791 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920795 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920799 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920802 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920805 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920808 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920811 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920814 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920817 2572 flags.go:64] FLAG: --cgroup-root="" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920820 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920823 2572 flags.go:64] FLAG: --client-ca-file="" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920827 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920830 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 15:32:10.924125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920835 2572 flags.go:64] FLAG: --cluster-domain="" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920837 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920840 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920844 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920848 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920852 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920855 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920858 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920861 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920864 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920867 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920869 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920873 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920876 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920880 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920883 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920887 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920889 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920893 2572 flags.go:64] FLAG: --enable-server="true" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920896 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920900 2572 flags.go:64] FLAG: --event-burst="100" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920903 2572 flags.go:64] FLAG: --event-qps="50" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920906 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920909 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 15:32:10.924681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920911 2572 flags.go:64] FLAG: --eviction-hard="" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920915 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920918 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920921 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920924 2572 flags.go:64] FLAG: --eviction-soft="" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920926 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920929 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920933 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920936 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920939 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920941 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920944 2572 flags.go:64] FLAG: --feature-gates="" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920948 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920951 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920954 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920957 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920960 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920963 2572 flags.go:64] FLAG: --help="false" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920965 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-140-178.ec2.internal" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920968 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920972 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920974 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920978 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 15:32:10.925266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920981 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920984 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920987 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920989 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920992 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920995 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.920998 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921001 2572 flags.go:64] FLAG: --kube-reserved="" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921003 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921020 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921023 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921026 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921029 2572 flags.go:64] FLAG: --lock-file="" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921032 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921034 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921038 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921043 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921047 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921049 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921052 2572 flags.go:64] FLAG: --logging-format="text" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921055 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921062 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921065 2572 flags.go:64] FLAG: --manifest-url="" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921068 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921072 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 15:32:10.925885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921075 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921079 2572 flags.go:64] FLAG: --max-pods="110" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921082 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921085 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921088 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921091 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921094 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921096 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921109 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921116 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921120 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921123 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921126 2572 flags.go:64] FLAG: --pod-cidr="" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921129 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921134 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921137 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921140 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921143 2572 flags.go:64] FLAG: --port="10250" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921146 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921149 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c7f581ac0484774a" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921153 2572 flags.go:64] FLAG: --qos-reserved="" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921155 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921158 2572 flags.go:64] FLAG: --register-node="true" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921161 2572 flags.go:64] FLAG: --register-with-taints="" Jun 05 15:32:10.926512 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921165 2572 flags.go:64] FLAG: --registry-burst="10" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921169 2572 flags.go:64] FLAG: --registry-qps="5" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921172 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921174 2572 flags.go:64] FLAG: --reserved-memory="" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921178 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921182 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921185 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921188 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921191 2572 flags.go:64] FLAG: --runonce="false" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921193 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921196 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921199 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921202 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921205 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921208 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921211 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921214 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921217 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921220 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921223 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921226 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921229 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921232 2572 flags.go:64] FLAG: --system-cgroups="" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921234 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921240 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 15:32:10.927121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921243 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921245 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921250 2572 flags.go:64] FLAG: --tls-min-version="" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921252 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921255 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921258 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921261 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921264 2572 flags.go:64] FLAG: --v="2" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921268 2572 flags.go:64] FLAG: --version="false" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921272 2572 flags.go:64] FLAG: --vmodule="" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921276 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.921279 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921387 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921391 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921394 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921397 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921400 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921402 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921405 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921409 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921412 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921415 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921418 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:32:10.927738 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921421 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921423 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921426 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921428 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921431 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921433 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921436 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921439 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921442 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921444 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921447 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921449 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921452 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921456 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921459 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921462 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921464 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921467 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921470 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:32:10.928305 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921473 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921475 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921479 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921482 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921484 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921487 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921489 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921492 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921495 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921498 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921501 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921504 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921506 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921509 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921511 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921514 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921516 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921519 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921522 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:32:10.928786 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921524 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921527 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921529 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921532 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921534 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921537 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921540 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921542 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921544 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921547 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921549 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921552 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921554 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921557 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921560 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921564 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921566 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921569 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921571 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:32:10.929241 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921574 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921578 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921581 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921585 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921588 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921590 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921594 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921596 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921599 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921602 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921605 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921607 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921610 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921613 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921615 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921618 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921620 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921637 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921640 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921643 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:32:10.929758 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921645 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921648 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921650 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921653 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921657 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921660 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921663 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921666 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921670 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921673 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.921675 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.922586 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.929542 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.929664 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 15:32:10.930254 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.929683 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.929690 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929744 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929749 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929752 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929755 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929758 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929761 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929765 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929768 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929771 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929774 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929777 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929779 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929782 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929785 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929788 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929791 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929795 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:32:10.930609 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929798 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929801 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929804 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929807 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929810 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929813 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929816 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929819 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929821 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929824 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929827 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929829 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929832 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929835 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929838 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929841 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929844 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929846 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929849 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929852 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:32:10.931096 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929855 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929857 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929859 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929862 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929865 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929867 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929870 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929872 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929875 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929877 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929880 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929882 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929885 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929888 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929890 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929893 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929895 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929898 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929900 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929903 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:32:10.931582 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929906 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929909 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929912 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929914 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929918 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929921 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929923 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929926 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929930 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929933 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929944 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929947 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929951 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929955 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929959 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929962 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929965 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929968 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929971 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:32:10.932216 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929974 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929976 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929979 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929982 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929984 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929987 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929990 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929992 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929994 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.929997 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930000 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930002 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930005 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930007 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930011 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930014 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930016 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930019 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930022 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930025 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:32:10.932696 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930027 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930030 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930034 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.930038 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930145 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930149 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930152 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930154 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930157 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930160 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930163 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930166 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930168 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930171 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930174 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:32:10.933186 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930176 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930179 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930181 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930184 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930186 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930190 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930192 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930195 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930197 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930200 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930202 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930204 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930209 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930212 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930216 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930219 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930222 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930225 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930227 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:32:10.933544 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930230 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930233 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930235 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930238 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930240 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930243 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930245 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930248 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930250 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930254 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930258 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930261 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930264 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930266 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930269 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930271 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930274 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930276 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930279 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:32:10.934051 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930282 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930284 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930287 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930289 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930292 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930294 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930296 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930300 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930302 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930305 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930307 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930310 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930312 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930315 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930318 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930320 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930323 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930325 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930328 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930331 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:32:10.934514 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930333 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930336 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930338 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930341 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930343 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930346 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930348 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930351 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930353 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930356 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930358 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930361 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930364 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930367 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930369 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930372 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930374 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930377 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930379 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930382 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:32:10.935004 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930385 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930387 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930390 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930392 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930395 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930397 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930400 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930402 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930404 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:10.930408 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.930413 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.930503 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.932902 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.934475 2572 server.go:1019] "Starting client certificate rotation" Jun 05 15:32:10.935520 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.934578 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:32:10.935884 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.935243 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:32:10.938418 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.938402 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:32:10.942264 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.942247 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:32:10.954801 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.954780 2572 log.go:25] "Validated CRI v1 runtime API" Jun 05 15:32:10.957704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.957690 2572 log.go:25] "Validated CRI v1 image API" Jun 05 15:32:10.958482 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.958466 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 15:32:10.961008 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.960985 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9cbe4572-721d-43ab-8421-fe5681ad8ab1:/dev/nvme0n1p3 dc7b8871-3c0d-4306-9093-5e2bd7bb1980:/dev/nvme0n1p4] Jun 05 15:32:10.961094 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.961006 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 15:32:10.967068 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.966942 2572 manager.go:216] Machine: {Timestamp:2026-06-05 15:32:10.965543114 +0000 UTC m=+0.374681673 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100327 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b5baa2a0a5e7b99f9718f2e53f586 SystemUUID:ec2b5baa-2a0a-5e7b-99f9-718f2e53f586 BootID:d2ab7a7c-7fac-4af5-9965-f0d867824246 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:1d:4b:d2:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:1d:4b:d2:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:bf:43:01:76:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 15:32:10.967068 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.967054 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:32:10.967068 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.967065 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 15:32:10.967207 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.967145 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 15:32:10.970821 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.970800 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 15:32:10.970972 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.970823 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 15:32:10.971675 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.971664 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 15:32:10.971711 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.971678 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 15:32:10.971711 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.971686 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:32:10.972500 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.972490 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:32:10.973735 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.973725 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 15:32:10.978234 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978221 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:32:10.978355 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978346 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 15:32:10.978390 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978375 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 05 15:32:10.978390 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978384 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 15:32:10.978444 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978394 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 15:32:10.978444 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978402 2572 kubelet.go:398] "Adding apiserver pod source" Jun 05 15:32:10.978444 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978411 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 15:32:10.978763 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978752 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:32:10.978797 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.978772 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:32:10.981140 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.981126 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 15:32:10.982850 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.982838 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 15:32:10.982892 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.982867 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 15:32:10.984224 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984214 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 15:32:10.984258 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984228 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 15:32:10.984258 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984235 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 15:32:10.984258 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984240 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 15:32:10.984258 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984249 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 15:32:10.984258 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984254 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 15:32:10.984387 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984262 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 15:32:10.984387 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984267 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 15:32:10.984387 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984274 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 15:32:10.984387 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984279 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 15:32:10.984387 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984287 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 15:32:10.984387 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.984292 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 15:32:10.985102 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.985093 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 15:32:10.985102 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.985102 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 15:32:10.988350 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.988334 2572 server.go:1268] "Started kubelet" Jun 05 15:32:10.988908 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.988881 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 15:32:10.988999 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.988416 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 15:32:10.988999 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.988947 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 15:32:10.989496 ip-10-0-140-178 systemd[1]: Started Kubernetes Kubelet. Jun 05 15:32:10.994848 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.994814 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 15:32:10.995947 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.995928 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 05 15:32:10.996821 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:10.996796 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 15:32:10.998088 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:10.998065 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 15:32:10.998202 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:10.998189 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 15:32:10.998324 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:10.998307 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 15:32:10.999142 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:10.998013 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-178.ec2.internal.18b639245b7fa4bd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-178.ec2.internal,UID:ip-10-0-140-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-178.ec2.internal,},FirstTimestamp:2026-06-05 15:32:10.988307645 +0000 UTC m=+0.397446204,LastTimestamp:2026-06-05 15:32:10.988307645 +0000 UTC m=+0.397446204,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-178.ec2.internal,}" Jun 05 15:32:11.001458 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.001440 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 15:32:11.001522 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.001444 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 15:32:11.001574 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.001544 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.002243 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.002186 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 15:32:11.003175 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.002342 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 15:32:11.003250 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.003180 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 15:32:11.003308 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.003299 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 05 15:32:11.003308 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.003307 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 05 15:32:11.003616 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.003602 2572 factory.go:55] Registering systemd factory Jun 05 15:32:11.003752 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.003741 2572 factory.go:223] Registration of the systemd container factory successfully Jun 05 15:32:11.004308 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.004246 2572 factory.go:153] Registering CRI-O factory Jun 05 15:32:11.004308 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.004264 2572 factory.go:223] Registration of the crio container factory successfully Jun 05 15:32:11.004422 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.004316 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 15:32:11.004422 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.004342 2572 factory.go:103] Registering Raw factory Jun 05 15:32:11.004422 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.004358 2572 manager.go:1196] Started watching for new ooms in manager Jun 05 15:32:11.004811 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.004795 2572 manager.go:349] Starting recovery of all containers Jun 05 15:32:11.009489 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.009460 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 15:32:11.009615 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.009587 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 15:32:11.014458 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.014442 2572 manager.go:354] Recovery completed Jun 05 15:32:11.017839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.017823 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7sjsd" Jun 05 15:32:11.018136 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.018123 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:11.019962 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.019948 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:11.020017 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.019973 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:11.020017 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.019991 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:11.020474 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.020448 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 15:32:11.020474 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.020472 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 15:32:11.020585 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.020485 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:11.020585 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.020491 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:32:11.021836 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.021820 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:11.021906 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.021848 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:11.021906 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.021861 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:11.022482 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.022416 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-178.ec2.internal.18b639245d62a6f4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-178.ec2.internal,UID:ip-10-0-140-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-178.ec2.internal,},FirstTimestamp:2026-06-05 15:32:11.0199621 +0000 UTC m=+0.429100659,LastTimestamp:2026-06-05 15:32:11.0199621 +0000 UTC m=+0.429100659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-178.ec2.internal,}" Jun 05 15:32:11.022611 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.022599 2572 policy_none.go:49] "None policy: Start" Jun 05 15:32:11.022683 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.022619 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 15:32:11.022720 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.022692 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 15:32:11.024315 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.024305 2572 policy_none.go:47] "Start" Jun 05 15:32:11.026956 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.026928 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7sjsd" Jun 05 15:32:11.031812 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.031755 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-178.ec2.internal.18b639245d62e3f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-178.ec2.internal,UID:ip-10-0-140-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-178.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-178.ec2.internal,},FirstTimestamp:2026-06-05 15:32:11.019977715 +0000 UTC m=+0.429116273,LastTimestamp:2026-06-05 15:32:11.019977715 +0000 UTC m=+0.429116273,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-178.ec2.internal,}" Jun 05 15:32:11.058178 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.058163 2572 manager.go:337] "Starting Device Plugin manager" Jun 05 15:32:11.058240 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.058219 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 15:32:11.058240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.058228 2572 server.go:87] "Starting device plugin registration server" Jun 05 15:32:11.058487 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.058474 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 15:32:11.058536 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.058490 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 15:32:11.058581 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.058572 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 15:32:11.058683 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.058668 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 15:32:11.058683 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.058681 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 15:32:11.059377 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.059359 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 15:32:11.059445 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.059409 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.082298 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.082275 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 15:32:11.091320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.083402 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 15:32:11.091320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.083436 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 15:32:11.091320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.083454 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 15:32:11.091320 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.083513 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 15:32:11.091320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.086276 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:32:11.158760 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.158744 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:11.159574 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.159531 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:11.159574 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.159559 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:11.159574 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.159573 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:11.159774 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.159595 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.169183 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.169169 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.169232 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.169190 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-178.ec2.internal\": node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.184075 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.184050 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal"] Jun 05 15:32:11.184165 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.184104 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:11.185774 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.185758 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:11.185859 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.185790 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:11.185859 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.185803 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:11.188273 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.188259 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:11.188367 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.188354 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.188430 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.188380 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:11.188928 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.188910 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:11.189000 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.188937 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:11.189000 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.188948 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:11.189000 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.188912 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:11.189135 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.189026 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:11.189135 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.189043 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:11.191244 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.191229 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.191328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.191257 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:11.191946 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.191932 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:11.192024 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.191952 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:11.192024 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.191962 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:11.208850 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.208826 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.215139 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.215124 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-178.ec2.internal\" not found" node="ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.219375 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.219360 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-178.ec2.internal\" not found" node="ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.305153 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.305131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da0fa063dbe0100aefbaf62644f3598d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-178.ec2.internal\" (UID: \"da0fa063dbe0100aefbaf62644f3598d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.305251 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.305170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2190535f15042969d2f7610b5df81e06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal\" (UID: \"2190535f15042969d2f7610b5df81e06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.305251 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.305195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2190535f15042969d2f7610b5df81e06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal\" (UID: \"2190535f15042969d2f7610b5df81e06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.309227 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.309205 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.405577 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.405538 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da0fa063dbe0100aefbaf62644f3598d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-178.ec2.internal\" (UID: \"da0fa063dbe0100aefbaf62644f3598d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.405577 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.405493 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da0fa063dbe0100aefbaf62644f3598d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-178.ec2.internal\" (UID: \"da0fa063dbe0100aefbaf62644f3598d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.405812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.405608 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2190535f15042969d2f7610b5df81e06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal\" (UID: \"2190535f15042969d2f7610b5df81e06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.405812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.405648 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2190535f15042969d2f7610b5df81e06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal\" (UID: \"2190535f15042969d2f7610b5df81e06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.405812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.405694 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2190535f15042969d2f7610b5df81e06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal\" (UID: \"2190535f15042969d2f7610b5df81e06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.405812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.405752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2190535f15042969d2f7610b5df81e06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal\" (UID: \"2190535f15042969d2f7610b5df81e06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.409658 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.409600 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.510505 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.510470 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.521677 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.521657 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.526844 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.526245 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:11.610841 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.610810 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.711442 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.711381 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.811952 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.811928 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.912591 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:11.912565 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:11.933736 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.933718 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 15:32:11.933906 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:11.933889 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 15:32:12.013666 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:12.013600 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:12.031408 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.031370 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 15:27:11 +0000 UTC" deadline="2028-01-13 12:27:24.711083881 +0000 UTC" Jun 05 15:32:12.031408 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.031400 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14084h55m12.679687866s" Jun 05 15:32:12.057303 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:12.057273 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0fa063dbe0100aefbaf62644f3598d.slice/crio-1452eea5f16a3e1ae5b7b4e7da06dfba0ac49193f0826e5f38a90ce3b8b3aec6 WatchSource:0}: Error finding container 1452eea5f16a3e1ae5b7b4e7da06dfba0ac49193f0826e5f38a90ce3b8b3aec6: Status 404 returned error can't find the container with id 1452eea5f16a3e1ae5b7b4e7da06dfba0ac49193f0826e5f38a90ce3b8b3aec6 Jun 05 15:32:12.057710 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:12.057687 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2190535f15042969d2f7610b5df81e06.slice/crio-9f9bfb032866698cf661bf5689ccf8e97e9b9a46375c4926aa06b9a07c01445f WatchSource:0}: Error finding container 9f9bfb032866698cf661bf5689ccf8e97e9b9a46375c4926aa06b9a07c01445f: Status 404 returned error can't find the container with id 9f9bfb032866698cf661bf5689ccf8e97e9b9a46375c4926aa06b9a07c01445f Jun 05 15:32:12.063080 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.062817 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:32:12.070676 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.070659 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:32:12.086202 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.086163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" event={"ID":"2190535f15042969d2f7610b5df81e06","Type":"ContainerStarted","Data":"9f9bfb032866698cf661bf5689ccf8e97e9b9a46375c4926aa06b9a07c01445f"} Jun 05 15:32:12.087074 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.087056 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" event={"ID":"da0fa063dbe0100aefbaf62644f3598d","Type":"ContainerStarted","Data":"1452eea5f16a3e1ae5b7b4e7da06dfba0ac49193f0826e5f38a90ce3b8b3aec6"} Jun 05 15:32:12.098209 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.098192 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:32:12.098901 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.098887 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:32:12.098961 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.098913 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:32:12.098961 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.098928 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:32:12.114136 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:12.114117 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:12.214604 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:12.214583 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:12.265604 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.264659 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:32:12.315621 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:12.315601 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-178.ec2.internal\" not found" Jun 05 15:32:12.350398 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.350377 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:32:12.402467 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.402446 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" Jun 05 15:32:12.412392 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.412374 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:32:12.414983 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.414970 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" Jun 05 15:32:12.429919 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.429893 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:32:12.979724 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.979697 2572 apiserver.go:52] "Watching apiserver" Jun 05 15:32:12.991204 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.991181 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 15:32:12.991561 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.991538 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-j7c54","openshift-multus/multus-additional-cni-plugins-nxhbx","openshift-multus/multus-p9nfc","openshift-network-diagnostics/network-check-target-996cf","openshift-network-operator/iptables-alerter-x4d4k","kube-system/global-pull-secret-syncer-blcwx","kube-system/konnectivity-agent-slwkp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g","openshift-cluster-node-tuning-operator/tuned-sf4fx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal","openshift-multus/network-metrics-daemon-8wl98","openshift-ovn-kubernetes/ovnkube-node-tmgwm","kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal","openshift-dns/node-resolver-wghj2"] Jun 05 15:32:12.994135 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.994115 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:12.996281 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.996261 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:12.996376 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:12.996327 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:12.998411 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.998390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9nfc" Jun 05 15:32:12.999828 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.999808 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 15:32:12.999917 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:12.999846 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r6r5f\"" Jun 05 15:32:13.000155 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.000139 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 15:32:13.001179 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.001162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:13.001282 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.001223 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:13.002118 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.002098 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 15:32:13.003461 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.003443 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.005749 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.005524 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.005835 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.005806 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:13.006974 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.006953 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 15:32:13.007934 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.007900 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.008689 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.008620 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 15:32:13.008689 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.008676 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 15:32:13.009121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.008959 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 15:32:13.009121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.009017 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k7bxz\"" Jun 05 15:32:13.010341 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.010311 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.011115 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.011087 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:32:13.011480 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.011455 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lmpnf\"" Jun 05 15:32:13.011722 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.011703 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 15:32:13.012199 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012182 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 15:32:13.012292 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012249 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 15:32:13.012292 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012258 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5kwbs\"" Jun 05 15:32:13.012432 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-netns\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012497 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-kubelet\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012497 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012472 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-daemon-config\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012497 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-multus-certs\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012666 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl6g2\" (UniqueName: \"kubernetes.io/projected/1dcc8331-f089-4f91-9d6b-d764d58734e0-kube-api-access-pl6g2\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012666 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eadb418e-7634-41fc-9d4c-d34da180d865-host-slash\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.012666 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7ebcc5d-aa0a-4153-9dcb-929733f3398f-agent-certs\") pod \"konnectivity-agent-slwkp\" (UID: \"e7ebcc5d-aa0a-4153-9dcb-929733f3398f\") " pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:13.012666 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-system-cni-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012666 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-cnibin\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012666 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-socket-dir-parent\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-k8s-cni-cncf-io\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012699 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpk8l\" (UniqueName: \"kubernetes.io/projected/44c3fb43-2064-4313-bcec-49d65a2676da-kube-api-access-rpk8l\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-os-release\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dcc8331-f089-4f91-9d6b-d764d58734e0-cni-binary-copy\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012810 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-cni-bin\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-etc-kubernetes\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eadb418e-7634-41fc-9d4c-d34da180d865-iptables-alerter-script\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f86g8\" (UniqueName: \"kubernetes.io/projected/eadb418e-7634-41fc-9d4c-d34da180d865-kube-api-access-f86g8\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-cni-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.012953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012959 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-cni-multus\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.013534 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.012981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-hostroot\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.013534 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.013008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-conf-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.013534 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.013056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7ebcc5d-aa0a-4153-9dcb-929733f3398f-konnectivity-ca\") pod \"konnectivity-agent-slwkp\" (UID: \"e7ebcc5d-aa0a-4153-9dcb-929733f3398f\") " pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:13.013534 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.013248 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 15:32:13.013929 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.013908 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nj9wn\"" Jun 05 15:32:13.014122 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.014103 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 15:32:13.014190 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.014133 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:32:13.015007 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.014990 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.017222 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.017204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.021364 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.021364 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021304 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 15:32:13.021364 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021316 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 15:32:13.022128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021372 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 15:32:13.022128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021588 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 15:32:13.022128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021728 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 15:32:13.022128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021754 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5x98n\"" Jun 05 15:32:13.022128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021934 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 15:32:13.022128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.021994 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8rbts\"" Jun 05 15:32:13.022128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.022123 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 15:32:13.022540 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.022254 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9wrkl\"" Jun 05 15:32:13.022540 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.022385 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 15:32:13.027833 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.027812 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 15:32:13.028507 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.028484 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 15:32:13.028616 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.028487 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-24fln\"" Jun 05 15:32:13.029046 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.028896 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 15:32:13.029046 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.028928 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 15:32:13.029046 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.028941 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 15:32:13.029046 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.028954 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 15:32:13.034312 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.034297 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:32:13.039683 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.039666 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:32:13.065613 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.065594 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sqlqd" Jun 05 15:32:13.083435 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.083416 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sqlqd" Jun 05 15:32:13.104342 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.104321 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 15:32:13.114250 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysconfig\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.114318 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-k8s-cni-cncf-io\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.114318 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-slash\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.114428 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-var-lib-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.114428 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:13.114428 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114374 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-k8s-cni-cncf-io\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.114428 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114423 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovn-node-metrics-cert\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.114554 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.114492 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:13.114554 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e052aaf8-33cd-421d-9173-1d49acbaef6e-kubelet-config\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.114663 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.114561 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:32:13.614532173 +0000 UTC m=+3.023670718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:13.114663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114580 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-hostroot\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.114663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114616 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-system-cni-dir\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.114795 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114678 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-hostroot\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.114795 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4cvh\" (UniqueName: \"kubernetes.io/projected/f284b810-0863-4c87-b40b-d33dcaa92cb7-kube-api-access-d4cvh\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.114795 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.114795 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysctl-d\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.114795 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-host\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.115021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl6g2\" (UniqueName: \"kubernetes.io/projected/1dcc8331-f089-4f91-9d6b-d764d58734e0-kube-api-access-pl6g2\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-sys-fs\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.115021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-cni-netd\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.115021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14f98abb-c0d9-454d-a858-daa8f53a564c-hosts-file\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.115021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-system-cni-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.114999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-socket-dir-parent\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115016 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-systemd\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-lib-modules\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115089 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-socket-dir-parent\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-os-release\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115120 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-etc-kubernetes\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115138 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-system-cni-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eadb418e-7634-41fc-9d4c-d34da180d865-iptables-alerter-script\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115144 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-os-release\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-etc-kubernetes\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f86g8\" (UniqueName: \"kubernetes.io/projected/eadb418e-7634-41fc-9d4c-d34da180d865-kube-api-access-f86g8\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f284b810-0863-4c87-b40b-d33dcaa92cb7-host\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-systemd\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115281 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwdhg\" (UniqueName: \"kubernetes.io/projected/0f1f3ef0-5c7b-4407-9297-744b429a84c9-kube-api-access-gwdhg\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115304 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-etc-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.115334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-cni-multus\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115371 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-cni-multus\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7ebcc5d-aa0a-4153-9dcb-929733f3398f-konnectivity-ca\") pod \"konnectivity-agent-slwkp\" (UID: \"e7ebcc5d-aa0a-4153-9dcb-929733f3398f\") " pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-tuned\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-kubelet\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eadb418e-7634-41fc-9d4c-d34da180d865-host-slash\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115683 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-socket-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-kubelet\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eadb418e-7634-41fc-9d4c-d34da180d865-iptables-alerter-script\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115717 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eadb418e-7634-41fc-9d4c-d34da180d865-host-slash\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-device-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-kubelet\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-cnibin\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115859 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f284b810-0863-4c87-b40b-d33dcaa92cb7-serviceca\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-ovn\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-cnibin\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115908 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7ebcc5d-aa0a-4153-9dcb-929733f3398f-konnectivity-ca\") pod \"konnectivity-agent-slwkp\" (UID: \"e7ebcc5d-aa0a-4153-9dcb-929733f3398f\") " pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-node-log\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.115978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-kubernetes\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-sys\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhrl\" (UniqueName: \"kubernetes.io/projected/516a3512-ae63-4b1a-8313-24cdfc6f6456-kube-api-access-flhrl\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dcc8331-f089-4f91-9d6b-d764d58734e0-cni-binary-copy\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116095 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-systemd-units\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116145 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-run-netns\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116178 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-env-overrides\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovnkube-script-lib\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116258 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-registration-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116281 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-modprobe-d\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-run\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116340 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516a3512-ae63-4b1a-8313-24cdfc6f6456-tmp\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116367 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-daemon-config\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.116839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7ebcc5d-aa0a-4153-9dcb-929733f3398f-agent-certs\") pod \"konnectivity-agent-slwkp\" (UID: \"e7ebcc5d-aa0a-4153-9dcb-929733f3398f\") " pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcqt5\" (UniqueName: \"kubernetes.io/projected/82c72e62-83fb-4306-b430-5b8e7e0b07cf-kube-api-access-lcqt5\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-cni-bin\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f98abb-c0d9-454d-a858-daa8f53a564c-tmp-dir\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116580 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpk8l\" (UniqueName: \"kubernetes.io/projected/44c3fb43-2064-4313-bcec-49d65a2676da-kube-api-access-rpk8l\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-log-socket\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysctl-conf\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-var-lib-kubelet\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116703 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dcc8331-f089-4f91-9d6b-d764d58734e0-cni-binary-copy\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-cni-bin\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cnibin\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-var-lib-cni-bin\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e052aaf8-33cd-421d-9173-1d49acbaef6e-dbus\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-cni-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.117521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116845 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-conf-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-os-release\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116922 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-cni-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116935 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-conf-dir\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.116978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovnkube-config\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx88p\" (UniqueName: \"kubernetes.io/projected/14f98abb-c0d9-454d-a858-daa8f53a564c-kube-api-access-sx88p\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117058 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-netns\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-multus-certs\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117104 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-netns\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117138 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dcc8331-f089-4f91-9d6b-d764d58734e0-host-run-multus-certs\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th56m\" (UniqueName: \"kubernetes.io/projected/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-kube-api-access-th56m\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.118167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.117260 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dcc8331-f089-4f91-9d6b-d764d58734e0-multus-daemon-config\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.120011 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.119988 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7ebcc5d-aa0a-4153-9dcb-929733f3398f-agent-certs\") pod \"konnectivity-agent-slwkp\" (UID: \"e7ebcc5d-aa0a-4153-9dcb-929733f3398f\") " pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:13.125054 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.125022 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:32:13.125054 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.125047 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:32:13.125217 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.125060 2572 projected.go:196] Error preparing data for projected volume kube-api-access-h6dvg for pod openshift-network-diagnostics/network-check-target-996cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:13.125217 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.125110 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg podName:d029e15a-0f9e-467c-9091-3886632ce73d nodeName:}" failed. No retries permitted until 2026-06-05 15:32:13.625093164 +0000 UTC m=+3.034231728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h6dvg" (UniqueName: "kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg") pod "network-check-target-996cf" (UID: "d029e15a-0f9e-467c-9091-3886632ce73d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:13.126759 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.126505 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl6g2\" (UniqueName: \"kubernetes.io/projected/1dcc8331-f089-4f91-9d6b-d764d58734e0-kube-api-access-pl6g2\") pod \"multus-p9nfc\" (UID: \"1dcc8331-f089-4f91-9d6b-d764d58734e0\") " pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.127580 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.127558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f86g8\" (UniqueName: \"kubernetes.io/projected/eadb418e-7634-41fc-9d4c-d34da180d865-kube-api-access-f86g8\") pod \"iptables-alerter-x4d4k\" (UID: \"eadb418e-7634-41fc-9d4c-d34da180d865\") " pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.127674 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.127658 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpk8l\" (UniqueName: \"kubernetes.io/projected/44c3fb43-2064-4313-bcec-49d65a2676da-kube-api-access-rpk8l\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:13.217591 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-system-cni-dir\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.217762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217598 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4cvh\" (UniqueName: \"kubernetes.io/projected/f284b810-0863-4c87-b40b-d33dcaa92cb7-kube-api-access-d4cvh\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.217762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.217762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217679 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-system-cni-dir\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.217762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysctl-d\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.217762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-host\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.217762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.217762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-sys-fs\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217810 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-sys-fs\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-cni-netd\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysctl-d\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-host\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14f98abb-c0d9-454d-a858-daa8f53a564c-hosts-file\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217879 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-cni-netd\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-systemd\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-lib-modules\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218013 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.217950 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14f98abb-c0d9-454d-a858-daa8f53a564c-hosts-file\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-systemd\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f284b810-0863-4c87-b40b-d33dcaa92cb7-host\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-systemd\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwdhg\" (UniqueName: \"kubernetes.io/projected/0f1f3ef0-5c7b-4407-9297-744b429a84c9-kube-api-access-gwdhg\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218094 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-etc-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218105 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-lib-modules\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.218149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218113 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-systemd\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218075 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f284b810-0863-4c87-b40b-d33dcaa92cb7-host\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218119 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-etc-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-tuned\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218174 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-socket-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-device-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218233 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-kubelet\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f284b810-0863-4c87-b40b-d33dcaa92cb7-serviceca\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218298 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-kubelet\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-socket-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218327 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-device-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-ovn\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218376 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-run-ovn\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.218945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-node-log\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218403 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-node-log\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218406 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-kubernetes\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-sys\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218441 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-kubernetes\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flhrl\" (UniqueName: \"kubernetes.io/projected/516a3512-ae63-4b1a-8313-24cdfc6f6456-kube-api-access-flhrl\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-sys\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-systemd-units\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-run-netns\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-env-overrides\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovnkube-script-lib\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-run-netns\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-registration-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-modprobe-d\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218563 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-systemd-units\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-run\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516a3512-ae63-4b1a-8313-24cdfc6f6456-tmp\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.219886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218728 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f284b810-0863-4c87-b40b-d33dcaa92cb7-serviceca\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218766 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-run\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218728 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-registration-dir\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218860 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-modprobe-d\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218729 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcqt5\" (UniqueName: \"kubernetes.io/projected/82c72e62-83fb-4306-b430-5b8e7e0b07cf-kube-api-access-lcqt5\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-cni-bin\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f98abb-c0d9-454d-a858-daa8f53a564c-tmp-dir\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.218987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-log-socket\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysctl-conf\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-var-lib-kubelet\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cnibin\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-log-socket\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219216 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-env-overrides\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219241 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysctl-conf\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219272 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovnkube-script-lib\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-var-lib-kubelet\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.220755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219282 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-cni-bin\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e052aaf8-33cd-421d-9173-1d49acbaef6e-dbus\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219353 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-os-release\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219369 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f98abb-c0d9-454d-a858-daa8f53a564c-tmp-dir\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-os-release\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovnkube-config\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx88p\" (UniqueName: \"kubernetes.io/projected/14f98abb-c0d9-454d-a858-daa8f53a564c-kube-api-access-sx88p\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th56m\" (UniqueName: \"kubernetes.io/projected/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-kube-api-access-th56m\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e052aaf8-33cd-421d-9173-1d49acbaef6e-dbus\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219537 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cnibin\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysconfig\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.221393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219644 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-sysconfig\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.219735 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219807 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-slash\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.219817 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret podName:e052aaf8-33cd-421d-9173-1d49acbaef6e nodeName:}" failed. No retries permitted until 2026-06-05 15:32:13.719799527 +0000 UTC m=+3.128938089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret") pod "global-pull-secret-syncer-blcwx" (UID: "e052aaf8-33cd-421d-9173-1d49acbaef6e") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219854 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-host-slash\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219866 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82c72e62-83fb-4306-b430-5b8e7e0b07cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219872 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-var-lib-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1f3ef0-5c7b-4407-9297-744b429a84c9-var-lib-openvswitch\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovn-node-metrics-cert\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovnkube-config\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219889 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.219963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e052aaf8-33cd-421d-9173-1d49acbaef6e-kubelet-config\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.220033 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e052aaf8-33cd-421d-9173-1d49acbaef6e-kubelet-config\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.220109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82c72e62-83fb-4306-b430-5b8e7e0b07cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.220493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/516a3512-ae63-4b1a-8313-24cdfc6f6456-etc-tuned\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.221921 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.221277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516a3512-ae63-4b1a-8313-24cdfc6f6456-tmp\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.222334 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.222029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f1f3ef0-5c7b-4407-9297-744b429a84c9-ovn-node-metrics-cert\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.225758 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.225734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4cvh\" (UniqueName: \"kubernetes.io/projected/f284b810-0863-4c87-b40b-d33dcaa92cb7-kube-api-access-d4cvh\") pod \"node-ca-j7c54\" (UID: \"f284b810-0863-4c87-b40b-d33dcaa92cb7\") " pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.225875 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.225841 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwdhg\" (UniqueName: \"kubernetes.io/projected/0f1f3ef0-5c7b-4407-9297-744b429a84c9-kube-api-access-gwdhg\") pod \"ovnkube-node-tmgwm\" (UID: \"0f1f3ef0-5c7b-4407-9297-744b429a84c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.226080 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.226063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhrl\" (UniqueName: \"kubernetes.io/projected/516a3512-ae63-4b1a-8313-24cdfc6f6456-kube-api-access-flhrl\") pod \"tuned-sf4fx\" (UID: \"516a3512-ae63-4b1a-8313-24cdfc6f6456\") " pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.226710 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.226691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcqt5\" (UniqueName: \"kubernetes.io/projected/82c72e62-83fb-4306-b430-5b8e7e0b07cf-kube-api-access-lcqt5\") pod \"multus-additional-cni-plugins-nxhbx\" (UID: \"82c72e62-83fb-4306-b430-5b8e7e0b07cf\") " pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.228271 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.228246 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th56m\" (UniqueName: \"kubernetes.io/projected/f7cbbb8e-333d-4fee-aea6-9477e05fb2bd-kube-api-access-th56m\") pod \"aws-ebs-csi-driver-node-j7x2g\" (UID: \"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.228588 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.228574 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx88p\" (UniqueName: \"kubernetes.io/projected/14f98abb-c0d9-454d-a858-daa8f53a564c-kube-api-access-sx88p\") pod \"node-resolver-wghj2\" (UID: \"14f98abb-c0d9-454d-a858-daa8f53a564c\") " pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.305611 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.305505 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:13.312393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.312373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9nfc" Jun 05 15:32:13.324248 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.324231 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4d4k" Jun 05 15:32:13.328905 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.328880 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" Jun 05 15:32:13.335516 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.335497 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wghj2" Jun 05 15:32:13.342164 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.342143 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" Jun 05 15:32:13.348707 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.348687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" Jun 05 15:32:13.354239 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.354214 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j7c54" Jun 05 15:32:13.359826 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.359809 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:13.623421 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.623343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:13.623552 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.623505 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:13.623602 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.623574 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:32:14.623554622 +0000 UTC m=+4.032693170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:13.723867 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.723837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:13.724044 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:13.723874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:13.724044 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.723995 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:13.724044 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.724022 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:32:13.724044 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.724046 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:32:13.724213 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.724053 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret podName:e052aaf8-33cd-421d-9173-1d49acbaef6e nodeName:}" failed. No retries permitted until 2026-06-05 15:32:14.724033615 +0000 UTC m=+4.133172161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret") pod "global-pull-secret-syncer-blcwx" (UID: "e052aaf8-33cd-421d-9173-1d49acbaef6e") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:13.724213 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.724060 2572 projected.go:196] Error preparing data for projected volume kube-api-access-h6dvg for pod openshift-network-diagnostics/network-check-target-996cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:13.724213 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:13.724114 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg podName:d029e15a-0f9e-467c-9091-3886632ce73d nodeName:}" failed. No retries permitted until 2026-06-05 15:32:14.724096938 +0000 UTC m=+4.133235507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6dvg" (UniqueName: "kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg") pod "network-check-target-996cf" (UID: "d029e15a-0f9e-467c-9091-3886632ce73d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:13.916915 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:13.916883 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadb418e_7634_41fc_9d4c_d34da180d865.slice/crio-4b9491b17ecbe0bece575f1bfa0917c32cfe5a8aa152e4bdceb0c4ab8b5e9622 WatchSource:0}: Error finding container 4b9491b17ecbe0bece575f1bfa0917c32cfe5a8aa152e4bdceb0c4ab8b5e9622: Status 404 returned error can't find the container with id 4b9491b17ecbe0bece575f1bfa0917c32cfe5a8aa152e4bdceb0c4ab8b5e9622 Jun 05 15:32:13.918041 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:13.917928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f98abb_c0d9_454d_a858_daa8f53a564c.slice/crio-1a864a3be702fc365d51701b3fcd1318665151fe9f148bebcb2287137b154029 WatchSource:0}: Error finding container 1a864a3be702fc365d51701b3fcd1318665151fe9f148bebcb2287137b154029: Status 404 returned error can't find the container with id 1a864a3be702fc365d51701b3fcd1318665151fe9f148bebcb2287137b154029 Jun 05 15:32:13.919201 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:13.919180 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcc8331_f089_4f91_9d6b_d764d58734e0.slice/crio-8b0359c5905df9eccc2adf7993b679bb844a04946f9a21da6d3cebc818865d95 WatchSource:0}: Error finding container 8b0359c5905df9eccc2adf7993b679bb844a04946f9a21da6d3cebc818865d95: Status 404 returned error can't find the container with id 8b0359c5905df9eccc2adf7993b679bb844a04946f9a21da6d3cebc818865d95 Jun 05 15:32:13.939976 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:13.939955 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516a3512_ae63_4b1a_8313_24cdfc6f6456.slice/crio-f6198c8a4b75bccf2311024eca88f82ce46675f06421e5093b15dda9f47c42da WatchSource:0}: Error finding container f6198c8a4b75bccf2311024eca88f82ce46675f06421e5093b15dda9f47c42da: Status 404 returned error can't find the container with id f6198c8a4b75bccf2311024eca88f82ce46675f06421e5093b15dda9f47c42da Jun 05 15:32:13.942721 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:13.942697 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf284b810_0863_4c87_b40b_d33dcaa92cb7.slice/crio-fba3a3d9dce408c63ee8ba765887911f2ab72b8cdb358956213bc813775885ea WatchSource:0}: Error finding container fba3a3d9dce408c63ee8ba765887911f2ab72b8cdb358956213bc813775885ea: Status 404 returned error can't find the container with id fba3a3d9dce408c63ee8ba765887911f2ab72b8cdb358956213bc813775885ea Jun 05 15:32:13.944288 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:13.944267 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ebcc5d_aa0a_4153_9dcb_929733f3398f.slice/crio-b02d71be868b10ce1de3316a493d34dcfa2145c0757025918efb8da479ebe2e7 WatchSource:0}: Error finding container b02d71be868b10ce1de3316a493d34dcfa2145c0757025918efb8da479ebe2e7: Status 404 returned error can't find the container with id b02d71be868b10ce1de3316a493d34dcfa2145c0757025918efb8da479ebe2e7 Jun 05 15:32:13.945585 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:13.945563 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1f3ef0_5c7b_4407_9297_744b429a84c9.slice/crio-ca9e02609b7218a5056003644e98a7ed4e80f36008affaf37cd8d1994b93ecbf WatchSource:0}: Error finding container ca9e02609b7218a5056003644e98a7ed4e80f36008affaf37cd8d1994b93ecbf: Status 404 returned error can't find the container with id ca9e02609b7218a5056003644e98a7ed4e80f36008affaf37cd8d1994b93ecbf Jun 05 15:32:14.087036 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.086989 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:27:13 +0000 UTC" deadline="2028-03-02 04:52:02.091533032 +0000 UTC" Jun 05 15:32:14.087036 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.087034 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15253h19m48.004502337s" Jun 05 15:32:14.093940 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.093913 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" event={"ID":"da0fa063dbe0100aefbaf62644f3598d","Type":"ContainerStarted","Data":"a945cf9f740ad439365305aacd926c5804c11ebf8e4bbb8f742fb49f9ccab4b8"} Jun 05 15:32:14.094992 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.094937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" event={"ID":"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd","Type":"ContainerStarted","Data":"3f34f79665b32ac8543eba28a606597a417ad8ab0486234a6e139bb06c181930"} Jun 05 15:32:14.098206 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.098186 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerStarted","Data":"c11f730d2368a4d3cc125b4dbed026264027d353964d52363866613650816740"} Jun 05 15:32:14.103486 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.103462 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j7c54" event={"ID":"f284b810-0863-4c87-b40b-d33dcaa92cb7","Type":"ContainerStarted","Data":"fba3a3d9dce408c63ee8ba765887911f2ab72b8cdb358956213bc813775885ea"} Jun 05 15:32:14.104857 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.104814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9nfc" event={"ID":"1dcc8331-f089-4f91-9d6b-d764d58734e0","Type":"ContainerStarted","Data":"8b0359c5905df9eccc2adf7993b679bb844a04946f9a21da6d3cebc818865d95"} Jun 05 15:32:14.105820 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.105803 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" event={"ID":"516a3512-ae63-4b1a-8313-24cdfc6f6456","Type":"ContainerStarted","Data":"f6198c8a4b75bccf2311024eca88f82ce46675f06421e5093b15dda9f47c42da"} Jun 05 15:32:14.107110 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.107092 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"ca9e02609b7218a5056003644e98a7ed4e80f36008affaf37cd8d1994b93ecbf"} Jun 05 15:32:14.109208 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.109191 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-slwkp" event={"ID":"e7ebcc5d-aa0a-4153-9dcb-929733f3398f","Type":"ContainerStarted","Data":"b02d71be868b10ce1de3316a493d34dcfa2145c0757025918efb8da479ebe2e7"} Jun 05 15:32:14.111411 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.111389 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wghj2" event={"ID":"14f98abb-c0d9-454d-a858-daa8f53a564c","Type":"ContainerStarted","Data":"1a864a3be702fc365d51701b3fcd1318665151fe9f148bebcb2287137b154029"} Jun 05 15:32:14.112332 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.112313 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4d4k" event={"ID":"eadb418e-7634-41fc-9d4c-d34da180d865","Type":"ContainerStarted","Data":"4b9491b17ecbe0bece575f1bfa0917c32cfe5a8aa152e4bdceb0c4ab8b5e9622"} Jun 05 15:32:14.630694 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.630399 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:14.630694 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.630585 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:14.630694 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.630665 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:32:16.630644484 +0000 UTC m=+6.039783034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:14.731917 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.731761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:14.731917 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:14.731816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:14.732143 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.731950 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:14.732143 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.732011 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret podName:e052aaf8-33cd-421d-9173-1d49acbaef6e nodeName:}" failed. No retries permitted until 2026-06-05 15:32:16.731994378 +0000 UTC m=+6.141132936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret") pod "global-pull-secret-syncer-blcwx" (UID: "e052aaf8-33cd-421d-9173-1d49acbaef6e") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:14.732538 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.732391 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:32:14.732538 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.732414 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:32:14.732538 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.732426 2572 projected.go:196] Error preparing data for projected volume kube-api-access-h6dvg for pod openshift-network-diagnostics/network-check-target-996cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:14.732538 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:14.732475 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg podName:d029e15a-0f9e-467c-9091-3886632ce73d nodeName:}" failed. No retries permitted until 2026-06-05 15:32:16.732459128 +0000 UTC m=+6.141597678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6dvg" (UniqueName: "kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg") pod "network-check-target-996cf" (UID: "d029e15a-0f9e-467c-9091-3886632ce73d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:15.084620 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.084543 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:15.086937 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:15.086905 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:15.087290 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.087270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:15.087658 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:15.087378 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:15.087658 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.087427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:15.087658 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:15.087488 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:15.087658 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.087554 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:27:13 +0000 UTC" deadline="2027-12-15 07:44:46.425621041 +0000 UTC" Jun 05 15:32:15.087658 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.087575 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13384h12m31.338050164s" Jun 05 15:32:15.129133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.129060 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" event={"ID":"2190535f15042969d2f7610b5df81e06","Type":"ContainerDied","Data":"be9d26ec8dfeb8070f8d5a2092095223b8f6cb47f22767f21643b2ed93024712"} Jun 05 15:32:15.129479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.129449 2572 generic.go:356] "Generic (PLEG): container finished" podID="2190535f15042969d2f7610b5df81e06" containerID="be9d26ec8dfeb8070f8d5a2092095223b8f6cb47f22767f21643b2ed93024712" exitCode=0 Jun 05 15:32:15.149448 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:15.149393 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-178.ec2.internal" podStartSLOduration=3.149372848 podStartE2EDuration="3.149372848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:14.109558592 +0000 UTC m=+3.518697159" watchObservedRunningTime="2026-06-05 15:32:15.149372848 +0000 UTC m=+4.558511418" Jun 05 15:32:16.168442 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:16.166214 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" event={"ID":"2190535f15042969d2f7610b5df81e06","Type":"ContainerStarted","Data":"2be170b5d485c18291726c3b4a9394f2032c4125019be71eda1e6b627f1b0df3"} Jun 05 15:32:16.649112 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:16.649027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:16.649266 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.649171 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:16.649266 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.649232 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:32:20.649213029 +0000 UTC m=+10.058351605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:16.750278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:16.750342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.750507 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.750566 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret podName:e052aaf8-33cd-421d-9173-1d49acbaef6e nodeName:}" failed. No retries permitted until 2026-06-05 15:32:20.750546635 +0000 UTC m=+10.159685183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret") pod "global-pull-secret-syncer-blcwx" (UID: "e052aaf8-33cd-421d-9173-1d49acbaef6e") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.751000 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.751024 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.751037 2572 projected.go:196] Error preparing data for projected volume kube-api-access-h6dvg for pod openshift-network-diagnostics/network-check-target-996cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:16.751123 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:16.751084 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg podName:d029e15a-0f9e-467c-9091-3886632ce73d nodeName:}" failed. No retries permitted until 2026-06-05 15:32:20.751069204 +0000 UTC m=+10.160207753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6dvg" (UniqueName: "kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg") pod "network-check-target-996cf" (UID: "d029e15a-0f9e-467c-9091-3886632ce73d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:17.084708 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:17.084051 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:17.084708 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:17.084053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:17.084708 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:17.084185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:17.084708 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:17.084183 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:17.084708 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:17.084266 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:17.084708 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:17.084344 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:19.088829 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:19.088769 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:19.089281 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:19.088909 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:19.089339 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:19.089316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:19.089550 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:19.089413 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:19.089550 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:19.089525 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:19.089741 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:19.089636 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:20.682903 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:20.682865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:20.683396 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.683045 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:20.683396 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.683105 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:32:28.683087721 +0000 UTC m=+18.092226274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:20.783350 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:20.783315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:20.783531 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:20.783371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:20.783531 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.783484 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:20.783531 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.783496 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:32:20.783531 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.783511 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:32:20.783531 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.783522 2572 projected.go:196] Error preparing data for projected volume kube-api-access-h6dvg for pod openshift-network-diagnostics/network-check-target-996cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:20.783758 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.783544 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret podName:e052aaf8-33cd-421d-9173-1d49acbaef6e nodeName:}" failed. No retries permitted until 2026-06-05 15:32:28.783526139 +0000 UTC m=+18.192664699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret") pod "global-pull-secret-syncer-blcwx" (UID: "e052aaf8-33cd-421d-9173-1d49acbaef6e") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:20.783758 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:20.783561 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg podName:d029e15a-0f9e-467c-9091-3886632ce73d nodeName:}" failed. No retries permitted until 2026-06-05 15:32:28.78355267 +0000 UTC m=+18.192691215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6dvg" (UniqueName: "kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg") pod "network-check-target-996cf" (UID: "d029e15a-0f9e-467c-9091-3886632ce73d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:21.084169 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:21.083676 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:21.084169 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:21.083816 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:21.084169 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:21.083676 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:21.084169 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:21.083938 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:21.084879 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:21.084857 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:21.085129 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:21.085109 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:23.084165 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:23.084130 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:23.084165 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:23.084153 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:23.084728 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:23.084140 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:23.084728 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:23.084264 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:23.084728 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:23.084332 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:23.084728 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:23.084407 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:25.083738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:25.083704 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:25.083738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:25.083733 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:25.084302 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:25.083705 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:25.084302 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:25.083853 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:25.084302 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:25.083977 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:25.084302 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:25.084053 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:27.083724 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:27.083687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:27.084187 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:27.083687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:27.084187 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:27.083816 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:27.084187 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:27.083687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:27.084187 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:27.083880 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:27.084187 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:27.083948 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:28.746657 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:28.746613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:28.747084 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.746786 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:28.747084 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.746859 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:32:44.746837758 +0000 UTC m=+34.155976309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:28.847022 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:28.846989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:28.847204 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:28.847039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:28.847204 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.847137 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:28.847204 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.847163 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:32:28.847204 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.847185 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:32:28.847204 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.847194 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret podName:e052aaf8-33cd-421d-9173-1d49acbaef6e nodeName:}" failed. No retries permitted until 2026-06-05 15:32:44.84717965 +0000 UTC m=+34.256318196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret") pod "global-pull-secret-syncer-blcwx" (UID: "e052aaf8-33cd-421d-9173-1d49acbaef6e") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:28.847204 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.847195 2572 projected.go:196] Error preparing data for projected volume kube-api-access-h6dvg for pod openshift-network-diagnostics/network-check-target-996cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:28.847448 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:28.847245 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg podName:d029e15a-0f9e-467c-9091-3886632ce73d nodeName:}" failed. No retries permitted until 2026-06-05 15:32:44.847227595 +0000 UTC m=+34.256366146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6dvg" (UniqueName: "kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg") pod "network-check-target-996cf" (UID: "d029e15a-0f9e-467c-9091-3886632ce73d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:29.084308 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:29.084222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:29.084455 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:29.084223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:29.084455 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:29.084352 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:29.084455 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:29.084223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:29.084455 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:29.084411 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:29.084719 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:29.084505 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:31.084556 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:31.084339 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:31.085042 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:31.084422 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:31.085042 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:31.084659 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:31.085042 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:31.084737 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:31.085042 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:31.084457 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:31.085042 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:31.084822 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:33.085124 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.084901 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:33.085738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.084899 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:33.085738 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:33.085232 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:33.085738 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.084899 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:33.085738 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:33.085318 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:33.085738 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:33.085402 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:33.200369 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.200342 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-slwkp" event={"ID":"e7ebcc5d-aa0a-4153-9dcb-929733f3398f","Type":"ContainerStarted","Data":"c14730b021e7c8cd02c03dc3dd42bf959c5366c101993af00e03365152b73c07"} Jun 05 15:32:33.201618 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.201595 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wghj2" event={"ID":"14f98abb-c0d9-454d-a858-daa8f53a564c","Type":"ContainerStarted","Data":"77958037a769891852c30c4192e5916d655409887672b7550d91770f13c3c4f9"} Jun 05 15:32:33.203026 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.203001 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" event={"ID":"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd","Type":"ContainerStarted","Data":"0f36181aa9f40309d315ce9ee80389e77a9957af3ba23d1c62a0b56bbe02b193"} Jun 05 15:32:33.204346 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.204325 2572 generic.go:356] "Generic (PLEG): container finished" podID="82c72e62-83fb-4306-b430-5b8e7e0b07cf" containerID="2d5f055c438d6ed6a3442eda2d5c9aaf8da29737e93efe6ecbd34829c319d7c7" exitCode=0 Jun 05 15:32:33.204443 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.204355 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerDied","Data":"2d5f055c438d6ed6a3442eda2d5c9aaf8da29737e93efe6ecbd34829c319d7c7"} Jun 05 15:32:33.205875 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.205844 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j7c54" event={"ID":"f284b810-0863-4c87-b40b-d33dcaa92cb7","Type":"ContainerStarted","Data":"67d5d949cf3ab42ec10830504f27726fccffc3e2eb4c5cb0c817835c18723b4d"} Jun 05 15:32:33.207246 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.207226 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9nfc" event={"ID":"1dcc8331-f089-4f91-9d6b-d764d58734e0","Type":"ContainerStarted","Data":"c1f5dee4a9f0ff1cfa3e423481201fe3424be4dc3d0a8941b19a03e5e6b8c54b"} Jun 05 15:32:33.208711 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.208687 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" event={"ID":"516a3512-ae63-4b1a-8313-24cdfc6f6456","Type":"ContainerStarted","Data":"faf9179f2c1f91ea43bb791376ef9268078e2fdcc52e85a9dcecb2ef6a0f99b7"} Jun 05 15:32:33.212076 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.212059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:32:33.212771 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.212748 2572 generic.go:356] "Generic (PLEG): container finished" podID="0f1f3ef0-5c7b-4407-9297-744b429a84c9" containerID="34b76fb30b1731a63493bcc4a9b2c361fd30440f7da30e98c0e4c801026e851a" exitCode=1 Jun 05 15:32:33.212863 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.212780 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"bfc873d6d4a52ae3b7d8e27d20d95027ffb74a256b6bc98946c245a67937b523"} Jun 05 15:32:33.212863 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.212827 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"11f34cd8b7d38828cbedb17a77f59805fee50e0e9dad921f3956a47df9d157da"} Jun 05 15:32:33.212863 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.212857 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerDied","Data":"34b76fb30b1731a63493bcc4a9b2c361fd30440f7da30e98c0e4c801026e851a"} Jun 05 15:32:33.212972 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.212886 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"3278fea926f816eb3ae8f99e8c14a203ce57dabb5410b95ba9f88554d2c61aaf"} Jun 05 15:32:33.219558 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.219525 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-178.ec2.internal" podStartSLOduration=21.219510953 podStartE2EDuration="21.219510953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:16.184169507 +0000 UTC m=+5.593308075" watchObservedRunningTime="2026-06-05 15:32:33.219510953 +0000 UTC m=+22.628649520" Jun 05 15:32:33.235516 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.235484 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-slwkp" podStartSLOduration=8.287363754 podStartE2EDuration="22.235471987s" totalImagesPullingTime="13.948108233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:33.219416125 +0000 UTC m=+22.628554703" watchObservedRunningTime="2026-06-05 15:32:33.235471987 +0000 UTC m=+22.644610553" Jun 05 15:32:33.235897 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.235857 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wghj2" podStartSLOduration=3.613136931 podStartE2EDuration="22.235850299s" totalImagesPullingTime="18.622713368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:33.235591443 +0000 UTC m=+22.644730009" watchObservedRunningTime="2026-06-05 15:32:33.235850299 +0000 UTC m=+22.644988866" Jun 05 15:32:33.277529 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.277491 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sf4fx" podStartSLOduration=3.659233042 podStartE2EDuration="22.277475936s" totalImagesPullingTime="18.618242894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:33.277223232 +0000 UTC m=+22.686361799" watchObservedRunningTime="2026-06-05 15:32:33.277475936 +0000 UTC m=+22.686614504" Jun 05 15:32:33.332545 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.332466 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p9nfc" podStartSLOduration=3.668685578 podStartE2EDuration="22.332446713s" totalImagesPullingTime="18.663761135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:33.327477698 +0000 UTC m=+22.736616264" watchObservedRunningTime="2026-06-05 15:32:33.332446713 +0000 UTC m=+22.741585281" Jun 05 15:32:33.333142 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.333111 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j7c54" podStartSLOduration=3.718436322 podStartE2EDuration="22.333102268s" totalImagesPullingTime="18.614665946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:33.297124811 +0000 UTC m=+22.706263378" watchObservedRunningTime="2026-06-05 15:32:33.333102268 +0000 UTC m=+22.742240832" Jun 05 15:32:33.869113 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:33.868946 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 15:32:34.070957 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.070818 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T15:32:33.869100254Z","UUID":"8029865a-b880-4b7c-b5c1-a9bc6beb53de","Handler":null,"Name":"","Endpoint":""} Jun 05 15:32:34.072145 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.072128 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 15:32:34.072244 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.072160 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 15:32:34.218154 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.218123 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:32:34.218603 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.218569 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"e8969f0409026f38184e9833123f4ba81c8181f254381081433c4c471b0a29d8"} Jun 05 15:32:34.218736 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.218696 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"75a7cf40763c5ded8106585ea74be86d62541420367ba83e162ca7fd95a3ce35"} Jun 05 15:32:34.220097 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.220072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4d4k" event={"ID":"eadb418e-7634-41fc-9d4c-d34da180d865","Type":"ContainerStarted","Data":"fea6c0b1a9f91cf420faf5aaa5db4b8b6b3ecce2873571b7dfcbcd5caa7e8bf7"} Jun 05 15:32:34.221990 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.221962 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" event={"ID":"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd","Type":"ContainerStarted","Data":"070c52a4a0c14cdf2030b14653d1e2c1e30652c03e621ae62b0f2d30460842d1"} Jun 05 15:32:34.235978 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:34.235942 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x4d4k" podStartSLOduration=4.594530223 podStartE2EDuration="23.235929472s" totalImagesPullingTime="18.641399249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:34.235774919 +0000 UTC m=+23.644913496" watchObservedRunningTime="2026-06-05 15:32:34.235929472 +0000 UTC m=+23.645068066" Jun 05 15:32:35.084392 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:35.084364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:35.084535 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:35.084368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:35.084535 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:35.084477 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:35.084660 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:35.084364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:35.084660 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:35.084561 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:35.084766 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:35.084681 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:35.098216 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:35.098195 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:35.098761 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:35.098744 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:35.225774 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:35.225693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" event={"ID":"f7cbbb8e-333d-4fee-aea6-9477e05fb2bd","Type":"ContainerStarted","Data":"c2ae50d236d410b9e30ce5ae94cf338be0bef457c973e2a13d8813cfcc53c7ff"} Jun 05 15:32:35.246820 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:35.246778 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7x2g" podStartSLOduration=3.722834576 podStartE2EDuration="24.24676561s" totalImagesPullingTime="20.523931034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:35.246310542 +0000 UTC m=+24.655449110" watchObservedRunningTime="2026-06-05 15:32:35.24676561 +0000 UTC m=+24.655904178" Jun 05 15:32:36.230521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:36.230496 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:32:36.231060 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:36.230912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"2e699fbffcb9cf14752de546798b61a218c040fdb5d2a6e3ae6ec21d20101cac"} Jun 05 15:32:36.231060 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:36.230963 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 15:32:37.083966 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:37.083935 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:37.084134 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:37.083935 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:37.084134 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:37.084067 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:37.084134 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:37.083940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:37.084245 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:37.084135 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:37.084245 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:37.084191 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:38.238765 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:38.238565 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:32:38.239265 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:38.239115 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"d3325895b939e0e8eef9d1d7d24c1440def1d569994f7f201d48cd4ee6d5305e"} Jun 05 15:32:38.239424 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:38.239397 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:38.239553 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:38.239536 2572 scope.go:117] "RemoveContainer" containerID="34b76fb30b1731a63493bcc4a9b2c361fd30440f7da30e98c0e4c801026e851a" Jun 05 15:32:38.241192 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:38.241167 2572 generic.go:356] "Generic (PLEG): container finished" podID="82c72e62-83fb-4306-b430-5b8e7e0b07cf" containerID="22b69adaa214072e40c1f7bb1d24082aed6f643d18169a88d0ea29a83eb78add" exitCode=0 Jun 05 15:32:38.241291 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:38.241211 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerDied","Data":"22b69adaa214072e40c1f7bb1d24082aed6f643d18169a88d0ea29a83eb78add"} Jun 05 15:32:38.254489 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:38.254471 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:39.042242 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.042210 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:39.042466 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.042388 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 15:32:39.042703 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.042682 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-slwkp" Jun 05 15:32:39.084807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.084782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:39.085071 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.084780 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:39.085367 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.084842 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:39.085367 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:39.085307 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:39.085367 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:39.085339 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:39.085367 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:39.085094 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:39.246217 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.246193 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:32:39.246679 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.246548 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" event={"ID":"0f1f3ef0-5c7b-4407-9297-744b429a84c9","Type":"ContainerStarted","Data":"6716b6e6278ee5f202f04414b079b541ae8c31dfa02a312a5bd870c65f3424db"} Jun 05 15:32:39.246679 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.246612 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 15:32:39.246981 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.246942 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:39.263734 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.263713 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:39.279878 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.279838 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" podStartSLOduration=9.588483676 podStartE2EDuration="28.279823419s" totalImagesPullingTime="18.691339743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:39.279344312 +0000 UTC m=+28.688482870" watchObservedRunningTime="2026-06-05 15:32:39.279823419 +0000 UTC m=+28.688961986" Jun 05 15:32:39.971187 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.971003 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-996cf"] Jun 05 15:32:39.971346 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.971272 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:39.971412 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:39.971378 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:39.974152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.974131 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-blcwx"] Jun 05 15:32:39.974279 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.974208 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:39.974347 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:39.974304 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:39.974814 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.974792 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wl98"] Jun 05 15:32:39.974897 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:39.974886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:39.974974 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:39.974960 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:40.251004 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:40.250974 2572 generic.go:356] "Generic (PLEG): container finished" podID="82c72e62-83fb-4306-b430-5b8e7e0b07cf" containerID="08d12ace09b42f69ddc1f50da22d63ff5241f4992c2d9b4d77f28794480646b7" exitCode=0 Jun 05 15:32:40.251407 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:40.251062 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerDied","Data":"08d12ace09b42f69ddc1f50da22d63ff5241f4992c2d9b4d77f28794480646b7"} Jun 05 15:32:40.251407 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:40.251225 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 15:32:41.084375 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:41.084350 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:41.084556 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:41.084445 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:41.253558 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:41.253526 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 15:32:41.486881 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:41.486820 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:32:42.084605 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:42.084530 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:42.084752 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:42.084534 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:42.084752 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:42.084647 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:42.084752 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:42.084732 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:42.258272 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:42.258235 2572 generic.go:356] "Generic (PLEG): container finished" podID="82c72e62-83fb-4306-b430-5b8e7e0b07cf" containerID="84bd3948c1bd73d72508284c07b079cd73b7983bc9c1a3a0196826450c57502d" exitCode=0 Jun 05 15:32:42.259054 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:42.258320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerDied","Data":"84bd3948c1bd73d72508284c07b079cd73b7983bc9c1a3a0196826450c57502d"} Jun 05 15:32:42.272541 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:42.272498 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" podUID="0f1f3ef0-5c7b-4407-9297-744b429a84c9" containerName="ovnkube-controller" probeResult="failure" output="" Jun 05 15:32:43.084716 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:43.084681 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:43.084884 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:43.084797 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:44.083867 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:44.083829 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:44.083867 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:44.083843 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:44.084340 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.083942 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:32:44.084340 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.084056 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-blcwx" podUID="e052aaf8-33cd-421d-9173-1d49acbaef6e" Jun 05 15:32:44.767062 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:44.767030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:44.767208 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.767173 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:44.767252 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.767239 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:33:16.767221762 +0000 UTC m=+66.176360311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:32:44.868337 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:44.868302 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:44.868880 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:44.868357 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:44.868880 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.868467 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:44.868880 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.868527 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret podName:e052aaf8-33cd-421d-9173-1d49acbaef6e nodeName:}" failed. No retries permitted until 2026-06-05 15:33:16.868509712 +0000 UTC m=+66.277648278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret") pod "global-pull-secret-syncer-blcwx" (UID: "e052aaf8-33cd-421d-9173-1d49acbaef6e") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:32:44.868880 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.868759 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:32:44.868880 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.868790 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:32:44.868880 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.868806 2572 projected.go:196] Error preparing data for projected volume kube-api-access-h6dvg for pod openshift-network-diagnostics/network-check-target-996cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:44.868880 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:44.868862 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg podName:d029e15a-0f9e-467c-9091-3886632ce73d nodeName:}" failed. No retries permitted until 2026-06-05 15:33:16.868845687 +0000 UTC m=+66.277984232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6dvg" (UniqueName: "kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg") pod "network-check-target-996cf" (UID: "d029e15a-0f9e-467c-9091-3886632ce73d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:32:45.084298 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.084141 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:45.084298 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.084278 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-996cf" podUID="d029e15a-0f9e-467c-9091-3886632ce73d" Jun 05 15:32:45.351571 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.351291 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-178.ec2.internal" event="NodeReady" Jun 05 15:32:45.351749 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.351663 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 15:32:45.397618 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.397558 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7"] Jun 05 15:32:45.402072 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.402052 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc7f5d48d-9cr8f"] Jun 05 15:32:45.402213 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.402187 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:45.405339 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.405318 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.405545 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.405526 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lstm9\"" Jun 05 15:32:45.405813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.405789 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 05 15:32:45.406456 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.406430 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 05 15:32:45.411013 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.410994 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 15:32:45.411240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.411220 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 15:32:45.411940 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.411918 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jcmnr\"" Jun 05 15:32:45.412132 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.412116 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 15:32:45.419918 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.419894 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 15:32:45.423637 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.423602 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dtgzv"] Jun 05 15:32:45.427021 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.427004 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7"] Jun 05 15:32:45.427113 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.427093 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.429756 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.429735 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc7f5d48d-9cr8f"] Jun 05 15:32:45.430542 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.430523 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 15:32:45.430839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.430818 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 15:32:45.430926 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.430898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 15:32:45.431005 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.430824 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rtd9k\"" Jun 05 15:32:45.432878 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.432860 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lfdf2"] Jun 05 15:32:45.436601 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.436584 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.439920 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.439902 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 15:32:45.440015 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.440003 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5jhbv\"" Jun 05 15:32:45.440276 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.440260 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 15:32:45.444789 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.444763 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtgzv"] Jun 05 15:32:45.450690 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.450613 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lfdf2"] Jun 05 15:32:45.473689 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.473665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-image-registry-private-configuration\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.473810 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.473792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.473887 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.473832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-installation-pull-secrets\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.473887 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.473875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-certificates\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.473982 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.473909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-bound-sa-token\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.473982 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.473945 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-ca-trust-extracted\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.474077 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.473963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-trusted-ca\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.474077 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.474039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svfls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-kube-api-access-svfls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.474176 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.474090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:45.474176 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.474124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03cbd584-f698-47be-b8db-30a25820e978-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:45.575416 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.575416 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-installation-pull-secrets\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.575680 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.575533 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:32:45.575680 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.575552 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:32:45.575680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvcbx\" (UniqueName: \"kubernetes.io/projected/de0874a1-c310-49ce-bfe0-067200199f9b-kube-api-access-mvcbx\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.575680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-certificates\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.575680 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.575614 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:46.075595555 +0000 UTC m=+35.484734102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:32:45.575680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-bound-sa-token\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-ca-trust-extracted\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-trusted-ca\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575746 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svfls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-kube-api-access-svfls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03cbd584-f698-47be-b8db-30a25820e978-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a9c053-831e-4872-8741-77156dedbd94-cert\") pod \"ingress-canary-dtgzv\" (UID: \"39a9c053-831e-4872-8741-77156dedbd94\") " pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de0874a1-c310-49ce-bfe0-067200199f9b-config-volume\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de0874a1-c310-49ce-bfe0-067200199f9b-tmp-dir\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.575969 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd676\" (UniqueName: \"kubernetes.io/projected/39a9c053-831e-4872-8741-77156dedbd94-kube-api-access-qd676\") pod \"ingress-canary-dtgzv\" (UID: \"39a9c053-831e-4872-8741-77156dedbd94\") " pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.576000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-image-registry-private-configuration\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.576044 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-ca-trust-extracted\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.576141 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.576126 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:32:45.576782 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.576160 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-certificates\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.576782 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.576210 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:46.076193106 +0000 UTC m=+35.485331672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:32:45.576782 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.576723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03cbd584-f698-47be-b8db-30a25820e978-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:45.576930 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.576825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-trusted-ca\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.580610 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.580574 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-image-registry-private-configuration\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.580610 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.580574 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-installation-pull-secrets\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.592114 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.592092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svfls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-kube-api-access-svfls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.596519 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.596496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-bound-sa-token\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:45.676806 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.676768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a9c053-831e-4872-8741-77156dedbd94-cert\") pod \"ingress-canary-dtgzv\" (UID: \"39a9c053-831e-4872-8741-77156dedbd94\") " pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.676945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.676813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de0874a1-c310-49ce-bfe0-067200199f9b-config-volume\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.676945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.676833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.676945 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.676856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de0874a1-c310-49ce-bfe0-067200199f9b-tmp-dir\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.677109 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.677026 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:32:45.677109 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.677085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd676\" (UniqueName: \"kubernetes.io/projected/39a9c053-831e-4872-8741-77156dedbd94-kube-api-access-qd676\") pod \"ingress-canary-dtgzv\" (UID: \"39a9c053-831e-4872-8741-77156dedbd94\") " pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.677109 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:45.677094 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:32:46.1770748 +0000 UTC m=+35.586213346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:32:45.677263 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.677190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de0874a1-c310-49ce-bfe0-067200199f9b-tmp-dir\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.677263 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.677192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvcbx\" (UniqueName: \"kubernetes.io/projected/de0874a1-c310-49ce-bfe0-067200199f9b-kube-api-access-mvcbx\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.677481 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.677456 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de0874a1-c310-49ce-bfe0-067200199f9b-config-volume\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.679487 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.679466 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a9c053-831e-4872-8741-77156dedbd94-cert\") pod \"ingress-canary-dtgzv\" (UID: \"39a9c053-831e-4872-8741-77156dedbd94\") " pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.704477 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.704457 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvcbx\" (UniqueName: \"kubernetes.io/projected/de0874a1-c310-49ce-bfe0-067200199f9b-kube-api-access-mvcbx\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:45.705500 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.705481 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd676\" (UniqueName: \"kubernetes.io/projected/39a9c053-831e-4872-8741-77156dedbd94-kube-api-access-qd676\") pod \"ingress-canary-dtgzv\" (UID: \"39a9c053-831e-4872-8741-77156dedbd94\") " pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.722934 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.722898 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:45.737773 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.737752 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtgzv" Jun 05 15:32:45.880141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:45.880088 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:46.080701 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.080614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:46.080701 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.080687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:46.080903 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:46.080744 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:32:46.080903 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:46.080768 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:32:46.080903 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:46.080800 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:32:46.080903 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:46.080830 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:47.080813625 +0000 UTC m=+36.489952173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:32:46.080903 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:46.080849 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:47.080839602 +0000 UTC m=+36.489978152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:32:46.084681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.084660 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:32:46.085022 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.084685 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:32:46.088664 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.088639 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:32:46.088775 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.088721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:32:46.088775 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.088756 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f757z\"" Jun 05 15:32:46.181787 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.181754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:46.181979 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:46.181927 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:32:46.182043 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:46.181997 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:32:47.181978771 +0000 UTC m=+36.591117318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:32:46.481697 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:46.481675 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtgzv"] Jun 05 15:32:46.486411 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:32:46.486384 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a9c053_831e_4872_8741_77156dedbd94.slice/crio-72efea9752ab3e9af25a3008986610d170d57d25d13d941f6d13820a2958e3a3 WatchSource:0}: Error finding container 72efea9752ab3e9af25a3008986610d170d57d25d13d941f6d13820a2958e3a3: Status 404 returned error can't find the container with id 72efea9752ab3e9af25a3008986610d170d57d25d13d941f6d13820a2958e3a3 Jun 05 15:32:47.083954 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.083913 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:32:47.086903 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.086879 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:32:47.087300 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.087018 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rhl2\"" Jun 05 15:32:47.087300 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.087131 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:32:47.088752 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.088725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:47.088866 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.088794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:47.088928 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:47.088876 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:32:47.088928 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:47.088894 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:32:47.089023 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:47.088928 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:32:47.089023 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:47.088961 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:49.088930164 +0000 UTC m=+38.498068718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:32:47.089023 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:47.088981 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:49.088970397 +0000 UTC m=+38.498108949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:32:47.190117 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.190092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:47.190226 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:47.190211 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:32:47.190271 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:47.190263 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:32:49.190246915 +0000 UTC m=+38.599385472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:32:47.272361 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.272328 2572 generic.go:356] "Generic (PLEG): container finished" podID="82c72e62-83fb-4306-b430-5b8e7e0b07cf" containerID="56340fbbf72d2476e7f3929b7d48d2b38e0c0f5663899248c924d61a4fe15f3b" exitCode=0 Jun 05 15:32:47.272506 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.272483 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerDied","Data":"56340fbbf72d2476e7f3929b7d48d2b38e0c0f5663899248c924d61a4fe15f3b"} Jun 05 15:32:47.273858 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:47.273829 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtgzv" event={"ID":"39a9c053-831e-4872-8741-77156dedbd94","Type":"ContainerStarted","Data":"72efea9752ab3e9af25a3008986610d170d57d25d13d941f6d13820a2958e3a3"} Jun 05 15:32:48.279594 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:48.279559 2572 generic.go:356] "Generic (PLEG): container finished" podID="82c72e62-83fb-4306-b430-5b8e7e0b07cf" containerID="429be4518c638701b4b05e3a6801d5e1c31a269db6c69b0c3734695298c740a8" exitCode=0 Jun 05 15:32:48.280016 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:48.279644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerDied","Data":"429be4518c638701b4b05e3a6801d5e1c31a269db6c69b0c3734695298c740a8"} Jun 05 15:32:48.926344 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:48.926309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:49.075864 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.075833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:49.106490 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.106465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:49.106616 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.106510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:49.106616 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:49.106598 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:32:49.106616 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:49.106616 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:32:49.106757 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:49.106647 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:32:49.106757 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:49.106680 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:53.106667058 +0000 UTC m=+42.515805621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:32:49.106757 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:49.106692 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:32:53.106687013 +0000 UTC m=+42.515825559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:32:49.168753 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.168726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:49.207465 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.207407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:49.207553 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:49.207528 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:32:49.207599 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:49.207571 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:32:53.207560082 +0000 UTC m=+42.616698628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:32:49.276426 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.276396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:49.284954 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.284926 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" event={"ID":"82c72e62-83fb-4306-b430-5b8e7e0b07cf","Type":"ContainerStarted","Data":"ec33d81239b0f7f539f5985322a55d4fa71839b42fa0e0fa1f94995caff7fce2"} Jun 05 15:32:49.286328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.286306 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtgzv" event={"ID":"39a9c053-831e-4872-8741-77156dedbd94","Type":"ContainerStarted","Data":"0d2b867a4f9202ad62a3a36070fcf250dd20e374024c03e3724db5c95ce587eb"} Jun 05 15:32:49.316405 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.316347 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nxhbx" podStartSLOduration=7.90064495 podStartE2EDuration="38.316329627s" totalImagesPullingTime="30.415684677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:49.314409885 +0000 UTC m=+38.723548454" watchObservedRunningTime="2026-06-05 15:32:49.316329627 +0000 UTC m=+38.725468197" Jun 05 15:32:49.337422 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.337380 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dtgzv" podStartSLOduration=2.196434988 podStartE2EDuration="4.337366896s" totalImagesPullingTime="2.140931908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:32:49.336743421 +0000 UTC m=+38.745881989" watchObservedRunningTime="2026-06-05 15:32:49.337366896 +0000 UTC m=+38.746505464" Jun 05 15:32:49.374241 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.374208 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:49.892908 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:49.892873 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" limit=1024 Jun 05 15:32:53.138147 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:53.138105 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:32:53.138596 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:53.138162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:32:53.138596 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:53.138256 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:32:53.138596 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:53.138271 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:32:53.138596 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:53.138273 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:32:53.138596 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:53.138322 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:33:01.138308344 +0000 UTC m=+50.547446917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:32:53.138596 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:53.138339 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:33:01.138332826 +0000 UTC m=+50.547471371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:32:53.239369 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:32:53.239336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:32:53.239507 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:53.239451 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:32:53.239507 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:32:53.239506 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:33:01.239490498 +0000 UTC m=+50.648629045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:33:01.198028 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:01.197986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:33:01.198485 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:01.198070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:33:01.198485 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:01.198141 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:33:01.198485 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:01.198207 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:33:17.198190635 +0000 UTC m=+66.607329180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:33:01.198485 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:01.198148 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:33:01.198485 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:01.198241 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:33:01.198485 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:01.198280 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:33:17.198268803 +0000 UTC m=+66.607407349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:33:01.298614 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:01.298583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:33:01.298817 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:01.298770 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:33:01.298883 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:01.298848 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:33:17.298828511 +0000 UTC m=+66.707967077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:33:12.268351 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:12.268318 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmgwm" Jun 05 15:33:16.813992 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.813947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:33:16.816808 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.816790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:33:16.824530 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:16.824505 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:33:16.824603 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:16.824587 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:34:20.824569383 +0000 UTC m=+130.233707934 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : secret "metrics-daemon-secret" not found Jun 05 15:33:16.915081 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.915042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:33:16.915081 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.915088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:33:16.919297 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.919278 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:33:16.919348 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.919283 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:33:16.928001 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.927974 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:33:16.928521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.928501 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e052aaf8-33cd-421d-9173-1d49acbaef6e-original-pull-secret\") pod \"global-pull-secret-syncer-blcwx\" (UID: \"e052aaf8-33cd-421d-9173-1d49acbaef6e\") " pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:33:16.938071 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.938044 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6dvg\" (UniqueName: \"kubernetes.io/projected/d029e15a-0f9e-467c-9091-3886632ce73d-kube-api-access-h6dvg\") pod \"network-check-target-996cf\" (UID: \"d029e15a-0f9e-467c-9091-3886632ce73d\") " pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:33:16.995169 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:16.995134 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-blcwx" Jun 05 15:33:17.097225 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.097197 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rhl2\"" Jun 05 15:33:17.104880 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.104856 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:33:17.125748 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.125715 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-blcwx"] Jun 05 15:33:17.129541 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:33:17.129508 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode052aaf8_33cd_421d_9173_1d49acbaef6e.slice/crio-3cb3616e01e72be0657e06a88468a17e010336fd5c10e316a811545383122806 WatchSource:0}: Error finding container 3cb3616e01e72be0657e06a88468a17e010336fd5c10e316a811545383122806: Status 404 returned error can't find the container with id 3cb3616e01e72be0657e06a88468a17e010336fd5c10e316a811545383122806 Jun 05 15:33:17.217189 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.217159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:33:17.217331 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.217218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:33:17.217331 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:17.217311 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:33:17.217331 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:17.217315 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:33:17.217331 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:17.217331 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:33:17.217459 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:17.217375 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:33:49.217361772 +0000 UTC m=+98.626500325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:33:17.217459 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:17.217390 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:33:49.217383956 +0000 UTC m=+98.626522502 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:33:17.266733 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.266697 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-996cf"] Jun 05 15:33:17.270326 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:33:17.270288 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd029e15a_0f9e_467c_9091_3886632ce73d.slice/crio-0928560f4e23d7f1c9c1de9177c3c46e88209237c62d48e9e006621e58459ee6 WatchSource:0}: Error finding container 0928560f4e23d7f1c9c1de9177c3c46e88209237c62d48e9e006621e58459ee6: Status 404 returned error can't find the container with id 0928560f4e23d7f1c9c1de9177c3c46e88209237c62d48e9e006621e58459ee6 Jun 05 15:33:17.317555 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.317520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:33:17.317754 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:17.317709 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:33:17.317844 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:17.317786 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:33:49.317764402 +0000 UTC m=+98.726902952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:33:17.349275 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.349193 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-996cf" event={"ID":"d029e15a-0f9e-467c-9091-3886632ce73d","Type":"ContainerStarted","Data":"0928560f4e23d7f1c9c1de9177c3c46e88209237c62d48e9e006621e58459ee6"} Jun 05 15:33:17.350257 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:17.350236 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-blcwx" event={"ID":"e052aaf8-33cd-421d-9173-1d49acbaef6e","Type":"ContainerStarted","Data":"3cb3616e01e72be0657e06a88468a17e010336fd5c10e316a811545383122806"} Jun 05 15:33:22.364479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:22.364438 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-996cf" event={"ID":"d029e15a-0f9e-467c-9091-3886632ce73d","Type":"ContainerStarted","Data":"029a5d70b5a8cd1d25b6d3c0d0b93de7dffc1451273015a24b33c2211bc01140"} Jun 05 15:33:22.364912 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:22.364574 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:33:22.365895 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:22.365874 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-blcwx" event={"ID":"e052aaf8-33cd-421d-9173-1d49acbaef6e","Type":"ContainerStarted","Data":"06dde3c3cebdcda90a0d36fa971b7cba8ac636881933f598322a8c29fc0832ea"} Jun 05 15:33:22.381604 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:22.381557 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-996cf" podStartSLOduration=67.005281532 podStartE2EDuration="1m11.381545254s" totalImagesPullingTime="4.376263722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:33:22.380666432 +0000 UTC m=+71.789805001" watchObservedRunningTime="2026-06-05 15:33:22.381545254 +0000 UTC m=+71.790683821" Jun 05 15:33:22.395356 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:22.395317 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-blcwx" podStartSLOduration=66.873873203 podStartE2EDuration="1m11.395307109s" totalImagesPullingTime="4.521433906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:33:22.394782778 +0000 UTC m=+71.803921346" watchObservedRunningTime="2026-06-05 15:33:22.395307109 +0000 UTC m=+71.804445676" Jun 05 15:33:49.240344 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:49.240305 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:33:49.240789 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:49.240353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:33:49.240789 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:49.240438 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:33:49.240789 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:49.240445 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:33:49.240789 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:49.240461 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:33:49.240789 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:49.240489 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:53.240476027 +0000 UTC m=+162.649614577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:33:49.240789 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:49.240520 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:53.240507946 +0000 UTC m=+162.649646492 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:33:49.341528 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:49.341494 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:33:49.341688 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:49.341648 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:33:49.341740 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:33:49.341716 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:34:53.341698881 +0000 UTC m=+162.750837426 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:33:53.370881 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:33:53.370851 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-996cf" Jun 05 15:34:20.860694 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:34:20.860656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:34:20.861161 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:20.860798 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:34:20.861161 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:20.860876 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:36:22.860860383 +0000 UTC m=+252.269998930 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : secret "metrics-daemon-secret" not found Jun 05 15:34:48.419228 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:48.419188 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" podUID="03cbd584-f698-47be-b8db-30a25820e978" Jun 05 15:34:48.425363 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:48.425336 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" Jun 05 15:34:48.445618 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:48.445595 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lfdf2" podUID="de0874a1-c310-49ce-bfe0-067200199f9b" Jun 05 15:34:48.572679 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:34:48.572650 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:34:48.572872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:34:48.572651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfdf2" Jun 05 15:34:48.572872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:34:48.572658 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:34:49.101111 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:49.101062 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:34:53.283715 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:34:53.283594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:34:53.283715 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:34:53.283700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:34:53.284196 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:53.283754 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:34:53.284196 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:53.283773 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f5d48d-9cr8f: secret "image-registry-tls" not found Jun 05 15:34:53.284196 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:53.283837 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 15:34:53.284196 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:53.283843 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls podName:b15e90e1-6655-4ac0-82f6-e0c2e973a3f0 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:55.283825692 +0000 UTC m=+284.692964247 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls") pod "image-registry-fc7f5d48d-9cr8f" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0") : secret "image-registry-tls" not found Jun 05 15:34:53.284196 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:53.283911 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert podName:03cbd584-f698-47be-b8db-30a25820e978 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:55.283893067 +0000 UTC m=+284.693031612 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rl7x7" (UID: "03cbd584-f698-47be-b8db-30a25820e978") : secret "networking-console-plugin-cert" not found Jun 05 15:34:53.384268 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:34:53.384238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:34:53.384408 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:53.384340 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:34:53.384408 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:34:53.384387 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls podName:de0874a1-c310-49ce-bfe0-067200199f9b nodeName:}" failed. No retries permitted until 2026-06-05 15:36:55.384374286 +0000 UTC m=+284.793512833 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls") pod "dns-default-lfdf2" (UID: "de0874a1-c310-49ce-bfe0-067200199f9b") : secret "dns-default-metrics-tls" not found Jun 05 15:35:04.083974 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:35:04.083927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:36:14.770129 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.770092 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg"] Jun 05 15:36:14.772830 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.772813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:14.775476 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.775452 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:36:14.775614 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.775503 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 05 15:36:14.776650 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.776583 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jh9j6\"" Jun 05 15:36:14.776650 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.776645 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 05 15:36:14.777002 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.776982 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 05 15:36:14.777883 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.777860 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp"] Jun 05 15:36:14.780760 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.780744 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-8sr6g"] Jun 05 15:36:14.780884 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.780868 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:14.783175 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.783157 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 15:36:14.783307 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.783292 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84"] Jun 05 15:36:14.783374 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.783314 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 15:36:14.783428 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.783387 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tzzq4\"" Jun 05 15:36:14.783480 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.783457 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:14.783539 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.783478 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 15:36:14.784717 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.784702 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 15:36:14.785949 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.785928 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-24b8p"] Jun 05 15:36:14.786037 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.785980 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qgwzh\"" Jun 05 15:36:14.786101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.786075 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:14.786155 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.786121 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 15:36:14.786155 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.786132 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 15:36:14.786622 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.786606 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 15:36:14.786997 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.786976 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 15:36:14.788688 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.788669 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:14.788804 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.788787 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:36:14.788871 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.788809 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 15:36:14.788927 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.788874 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gkfdz\"" Jun 05 15:36:14.788927 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.788788 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 15:36:14.789027 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.788964 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 15:36:14.790949 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.790930 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 15:36:14.791040 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.790986 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:36:14.791247 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.791232 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qx2m5\"" Jun 05 15:36:14.791378 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.791359 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 15:36:14.791452 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.791392 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 15:36:14.791578 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.791566 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 15:36:14.793729 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.793713 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg"] Jun 05 15:36:14.796038 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.796009 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 15:36:14.798032 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.798006 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp"] Jun 05 15:36:14.798993 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.798975 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8sr6g"] Jun 05 15:36:14.806520 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.806503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84"] Jun 05 15:36:14.812571 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.812552 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-24b8p"] Jun 05 15:36:14.938231 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2331941e-c023-4afb-b017-e1a3a796c555-trusted-ca-bundle\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:14.938231 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:14.938448 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938256 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2331941e-c023-4afb-b017-e1a3a796c555-snapshots\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:14.938448 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938283 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2331941e-c023-4afb-b017-e1a3a796c555-service-ca-bundle\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:14.938448 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-serving-cert\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:14.938448 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938363 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:14.938448 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-trusted-ca\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:14.938448 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f80bf5dc-734b-46f9-84db-971664d9e2da-config\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:14.938649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f80bf5dc-734b-46f9-84db-971664d9e2da-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:14.938649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-config\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:14.938649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938540 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2331941e-c023-4afb-b017-e1a3a796c555-tmp\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:14.938649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938560 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmn2s\" (UniqueName: \"kubernetes.io/projected/f80bf5dc-734b-46f9-84db-971664d9e2da-kube-api-access-tmn2s\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:14.938649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5728d9b-d895-49e0-87d6-8b1863c2447f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:14.938649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5728d9b-d895-49e0-87d6-8b1863c2447f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:14.938649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9m4j\" (UniqueName: \"kubernetes.io/projected/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-kube-api-access-p9m4j\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:14.938849 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwwz\" (UniqueName: \"kubernetes.io/projected/2331941e-c023-4afb-b017-e1a3a796c555-kube-api-access-fgwwz\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:14.938849 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938710 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6knl\" (UniqueName: \"kubernetes.io/projected/d5728d9b-d895-49e0-87d6-8b1863c2447f-kube-api-access-l6knl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:14.938849 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2331941e-c023-4afb-b017-e1a3a796c555-serving-cert\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:14.938849 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:14.938779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rct8f\" (UniqueName: \"kubernetes.io/projected/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-kube-api-access-rct8f\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.039937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.039857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-trusted-ca\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.039937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.039889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f80bf5dc-734b-46f9-84db-971664d9e2da-config\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:15.039937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.039911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f80bf5dc-734b-46f9-84db-971664d9e2da-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:15.040196 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.039948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-config\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.040196 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040071 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2331941e-c023-4afb-b017-e1a3a796c555-tmp\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.040196 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmn2s\" (UniqueName: \"kubernetes.io/projected/f80bf5dc-734b-46f9-84db-971664d9e2da-kube-api-access-tmn2s\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:15.040196 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040153 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5728d9b-d895-49e0-87d6-8b1863c2447f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:15.040391 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5728d9b-d895-49e0-87d6-8b1863c2447f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:15.040391 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9m4j\" (UniqueName: \"kubernetes.io/projected/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-kube-api-access-p9m4j\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:15.040391 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwwz\" (UniqueName: \"kubernetes.io/projected/2331941e-c023-4afb-b017-e1a3a796c555-kube-api-access-fgwwz\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.040391 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040287 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6knl\" (UniqueName: \"kubernetes.io/projected/d5728d9b-d895-49e0-87d6-8b1863c2447f-kube-api-access-l6knl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:15.040391 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2331941e-c023-4afb-b017-e1a3a796c555-serving-cert\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.040391 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rct8f\" (UniqueName: \"kubernetes.io/projected/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-kube-api-access-rct8f\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2331941e-c023-4afb-b017-e1a3a796c555-trusted-ca-bundle\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040436 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2331941e-c023-4afb-b017-e1a3a796c555-snapshots\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040463 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2331941e-c023-4afb-b017-e1a3a796c555-tmp\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2331941e-c023-4afb-b017-e1a3a796c555-service-ca-bundle\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-serving-cert\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:15.040673 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:15.040704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040700 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-config\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.041178 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:15.040742 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls podName:0e4c5a07-6763-4bd6-af89-99e4aec8b2a7 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:15.540725008 +0000 UTC m=+244.949863577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j76wp" (UID: "0e4c5a07-6763-4bd6-af89-99e4aec8b2a7") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:15.041178 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.040854 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-trusted-ca\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.041178 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.041108 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f80bf5dc-734b-46f9-84db-971664d9e2da-config\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:15.041339 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.041207 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5728d9b-d895-49e0-87d6-8b1863c2447f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:15.041648 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.041609 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2331941e-c023-4afb-b017-e1a3a796c555-service-ca-bundle\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.041844 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.041801 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2331941e-c023-4afb-b017-e1a3a796c555-trusted-ca-bundle\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.041911 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.041859 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:15.042011 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.041990 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2331941e-c023-4afb-b017-e1a3a796c555-snapshots\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.042855 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.042835 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f80bf5dc-734b-46f9-84db-971664d9e2da-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:15.042938 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.042921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2331941e-c023-4afb-b017-e1a3a796c555-serving-cert\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.043328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.043308 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5728d9b-d895-49e0-87d6-8b1863c2447f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:15.043404 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.043390 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-serving-cert\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.050036 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.050012 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rct8f\" (UniqueName: \"kubernetes.io/projected/5b976f8b-9cc9-47f9-97ae-ee538a7ea318-kube-api-access-rct8f\") pod \"console-operator-668fdbf85c-24b8p\" (UID: \"5b976f8b-9cc9-47f9-97ae-ee538a7ea318\") " pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.050036 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.050025 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmn2s\" (UniqueName: \"kubernetes.io/projected/f80bf5dc-734b-46f9-84db-971664d9e2da-kube-api-access-tmn2s\") pod \"service-ca-operator-6bc5ff68f5-pr8bg\" (UID: \"f80bf5dc-734b-46f9-84db-971664d9e2da\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:15.052820 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.052797 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9m4j\" (UniqueName: \"kubernetes.io/projected/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-kube-api-access-p9m4j\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:15.053912 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.053891 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwwz\" (UniqueName: \"kubernetes.io/projected/2331941e-c023-4afb-b017-e1a3a796c555-kube-api-access-fgwwz\") pod \"insights-operator-896549976-8sr6g\" (UID: \"2331941e-c023-4afb-b017-e1a3a796c555\") " pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.054004 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.053891 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6knl\" (UniqueName: \"kubernetes.io/projected/d5728d9b-d895-49e0-87d6-8b1863c2447f-kube-api-access-l6knl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mbm84\" (UID: \"d5728d9b-d895-49e0-87d6-8b1863c2447f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:15.081841 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.081820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" Jun 05 15:36:15.097508 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.097485 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8sr6g" Jun 05 15:36:15.105298 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.105275 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" Jun 05 15:36:15.110158 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.110128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:15.233932 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.233772 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg"] Jun 05 15:36:15.238005 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:15.237967 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80bf5dc_734b_46f9_84db_971664d9e2da.slice/crio-d360411e222fb7239f39d6ba3961f984408112cf0217bff1b35ac43dd31ceb61 WatchSource:0}: Error finding container d360411e222fb7239f39d6ba3961f984408112cf0217bff1b35ac43dd31ceb61: Status 404 returned error can't find the container with id d360411e222fb7239f39d6ba3961f984408112cf0217bff1b35ac43dd31ceb61 Jun 05 15:36:15.251279 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.251254 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8sr6g"] Jun 05 15:36:15.255363 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:15.255338 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2331941e_c023_4afb_b017_e1a3a796c555.slice/crio-805f9013b25aaeb19b586e1f83f90c18baa8b4f8fa33e43f01aaf3b08e0bb750 WatchSource:0}: Error finding container 805f9013b25aaeb19b586e1f83f90c18baa8b4f8fa33e43f01aaf3b08e0bb750: Status 404 returned error can't find the container with id 805f9013b25aaeb19b586e1f83f90c18baa8b4f8fa33e43f01aaf3b08e0bb750 Jun 05 15:36:15.268069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.268039 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84"] Jun 05 15:36:15.270491 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:15.270456 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5728d9b_d895_49e0_87d6_8b1863c2447f.slice/crio-3ebd7147fb1c945e5afe5a9b39ef75fb6704c6c0e5945d0d273693beb545dac4 WatchSource:0}: Error finding container 3ebd7147fb1c945e5afe5a9b39ef75fb6704c6c0e5945d0d273693beb545dac4: Status 404 returned error can't find the container with id 3ebd7147fb1c945e5afe5a9b39ef75fb6704c6c0e5945d0d273693beb545dac4 Jun 05 15:36:15.285241 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.285220 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-24b8p"] Jun 05 15:36:15.287916 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:15.287891 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b976f8b_9cc9_47f9_97ae_ee538a7ea318.slice/crio-173f8e31893c5a5ff7e6673dec752361748c42be3b76877cf604aa439e804a10 WatchSource:0}: Error finding container 173f8e31893c5a5ff7e6673dec752361748c42be3b76877cf604aa439e804a10: Status 404 returned error can't find the container with id 173f8e31893c5a5ff7e6673dec752361748c42be3b76877cf604aa439e804a10 Jun 05 15:36:15.545869 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.545788 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:15.546011 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:15.545900 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:15.546011 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:15.545952 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls podName:0e4c5a07-6763-4bd6-af89-99e4aec8b2a7 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:16.545938166 +0000 UTC m=+245.955076715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j76wp" (UID: "0e4c5a07-6763-4bd6-af89-99e4aec8b2a7") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:15.781683 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.781646 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8sr6g" event={"ID":"2331941e-c023-4afb-b017-e1a3a796c555","Type":"ContainerStarted","Data":"805f9013b25aaeb19b586e1f83f90c18baa8b4f8fa33e43f01aaf3b08e0bb750"} Jun 05 15:36:15.782597 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.782572 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" event={"ID":"5b976f8b-9cc9-47f9-97ae-ee538a7ea318","Type":"ContainerStarted","Data":"173f8e31893c5a5ff7e6673dec752361748c42be3b76877cf604aa439e804a10"} Jun 05 15:36:15.783598 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.783577 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" event={"ID":"d5728d9b-d895-49e0-87d6-8b1863c2447f","Type":"ContainerStarted","Data":"3ebd7147fb1c945e5afe5a9b39ef75fb6704c6c0e5945d0d273693beb545dac4"} Jun 05 15:36:15.784557 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:15.784539 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" event={"ID":"f80bf5dc-734b-46f9-84db-971664d9e2da","Type":"ContainerStarted","Data":"d360411e222fb7239f39d6ba3961f984408112cf0217bff1b35ac43dd31ceb61"} Jun 05 15:36:16.555246 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:16.555183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:16.555418 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:16.555351 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:16.555494 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:16.555430 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls podName:0e4c5a07-6763-4bd6-af89-99e4aec8b2a7 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:18.555409499 +0000 UTC m=+247.964548047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j76wp" (UID: "0e4c5a07-6763-4bd6-af89-99e4aec8b2a7") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:18.575279 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:18.575241 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:18.575712 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:18.575371 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:18.575712 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:18.575439 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls podName:0e4c5a07-6763-4bd6-af89-99e4aec8b2a7 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:22.575425191 +0000 UTC m=+251.984563738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j76wp" (UID: "0e4c5a07-6763-4bd6-af89-99e4aec8b2a7") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:19.799318 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.799283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8sr6g" event={"ID":"2331941e-c023-4afb-b017-e1a3a796c555","Type":"ContainerStarted","Data":"50e35cd5e8e61fbc5aa94ba59f05e5ac65c45ce7b7ef047c1e229b9989ec1fe1"} Jun 05 15:36:19.801017 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.800996 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/0.log" Jun 05 15:36:19.801149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.801035 2572 generic.go:356] "Generic (PLEG): container finished" podID="5b976f8b-9cc9-47f9-97ae-ee538a7ea318" containerID="10190348134cc8a5b8b58ccd86bc5a3ef52601462f8b7a288bd4b1dffe5ba275" exitCode=255 Jun 05 15:36:19.801149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.801109 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" event={"ID":"5b976f8b-9cc9-47f9-97ae-ee538a7ea318","Type":"ContainerDied","Data":"10190348134cc8a5b8b58ccd86bc5a3ef52601462f8b7a288bd4b1dffe5ba275"} Jun 05 15:36:19.801445 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.801303 2572 scope.go:117] "RemoveContainer" containerID="10190348134cc8a5b8b58ccd86bc5a3ef52601462f8b7a288bd4b1dffe5ba275" Jun 05 15:36:19.802947 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.802924 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" event={"ID":"d5728d9b-d895-49e0-87d6-8b1863c2447f","Type":"ContainerStarted","Data":"f04f9f020c568e7d686d19f420eb7d307e70525622f7802fa273bdc61a448412"} Jun 05 15:36:19.804495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.804476 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" event={"ID":"f80bf5dc-734b-46f9-84db-971664d9e2da","Type":"ContainerStarted","Data":"1c8f15f3a855a618099a25777ca7b476a352cf69116259f7fd107fb4a663b2eb"} Jun 05 15:36:19.819389 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.819342 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-8sr6g" podStartSLOduration=2.216476894 podStartE2EDuration="5.819324333s" totalImagesPullingTime="3.602847439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:19.818404552 +0000 UTC m=+249.227543204" watchObservedRunningTime="2026-06-05 15:36:19.819324333 +0000 UTC m=+249.228462903" Jun 05 15:36:19.835150 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.835099 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" podStartSLOduration=2.212087104 podStartE2EDuration="5.835080976s" totalImagesPullingTime="3.622993872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:19.834215909 +0000 UTC m=+249.243354478" watchObservedRunningTime="2026-06-05 15:36:19.835080976 +0000 UTC m=+249.244219545" Jun 05 15:36:19.851423 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:19.851378 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" podStartSLOduration=2.257114683 podStartE2EDuration="5.851363135s" totalImagesPullingTime="3.594248452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:19.850525716 +0000 UTC m=+249.259664287" watchObservedRunningTime="2026-06-05 15:36:19.851363135 +0000 UTC m=+249.260501703" Jun 05 15:36:20.809807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.809778 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:36:20.810240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.810225 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/0.log" Jun 05 15:36:20.810298 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.810266 2572 generic.go:356] "Generic (PLEG): container finished" podID="5b976f8b-9cc9-47f9-97ae-ee538a7ea318" containerID="7d567244c9864aa54b371c2f06e9c9d809383b2c6a7ddd162ac2512b9ee43d8a" exitCode=255 Jun 05 15:36:20.810404 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.810379 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" event={"ID":"5b976f8b-9cc9-47f9-97ae-ee538a7ea318","Type":"ContainerDied","Data":"7d567244c9864aa54b371c2f06e9c9d809383b2c6a7ddd162ac2512b9ee43d8a"} Jun 05 15:36:20.810478 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.810466 2572 scope.go:117] "RemoveContainer" containerID="10190348134cc8a5b8b58ccd86bc5a3ef52601462f8b7a288bd4b1dffe5ba275" Jun 05 15:36:20.810746 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.810702 2572 scope.go:117] "RemoveContainer" containerID="7d567244c9864aa54b371c2f06e9c9d809383b2c6a7ddd162ac2512b9ee43d8a" Jun 05 15:36:20.810921 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:20.810901 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-24b8p_openshift-console-operator(5b976f8b-9cc9-47f9-97ae-ee538a7ea318)\"" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" podUID="5b976f8b-9cc9-47f9-97ae-ee538a7ea318" Jun 05 15:36:20.862678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.862654 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj"] Jun 05 15:36:20.866589 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.866572 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" Jun 05 15:36:20.870218 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.870200 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 15:36:20.870320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.870200 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 15:36:20.870405 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.870392 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sdgnx\"" Jun 05 15:36:20.876740 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.876719 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj"] Jun 05 15:36:20.894644 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.894603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrz4z\" (UniqueName: \"kubernetes.io/projected/d8de78cc-6301-4ecc-a4a8-086750c2fa3b-kube-api-access-xrz4z\") pod \"migrator-955ffdf5f-kcgvj\" (UID: \"d8de78cc-6301-4ecc-a4a8-086750c2fa3b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" Jun 05 15:36:20.995484 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:20.995457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrz4z\" (UniqueName: \"kubernetes.io/projected/d8de78cc-6301-4ecc-a4a8-086750c2fa3b-kube-api-access-xrz4z\") pod \"migrator-955ffdf5f-kcgvj\" (UID: \"d8de78cc-6301-4ecc-a4a8-086750c2fa3b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" Jun 05 15:36:21.003437 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:21.003410 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrz4z\" (UniqueName: \"kubernetes.io/projected/d8de78cc-6301-4ecc-a4a8-086750c2fa3b-kube-api-access-xrz4z\") pod \"migrator-955ffdf5f-kcgvj\" (UID: \"d8de78cc-6301-4ecc-a4a8-086750c2fa3b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" Jun 05 15:36:21.175388 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:21.175359 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" Jun 05 15:36:21.293500 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:21.293467 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj"] Jun 05 15:36:21.296177 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:21.296150 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8de78cc_6301_4ecc_a4a8_086750c2fa3b.slice/crio-4a1a6ffb52674215d81de0e15fca36be8616e512d674b25753241454d20b9dba WatchSource:0}: Error finding container 4a1a6ffb52674215d81de0e15fca36be8616e512d674b25753241454d20b9dba: Status 404 returned error can't find the container with id 4a1a6ffb52674215d81de0e15fca36be8616e512d674b25753241454d20b9dba Jun 05 15:36:21.766311 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:21.766281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wghj2_14f98abb-c0d9-454d-a858-daa8f53a564c/dns-node-resolver/0.log" Jun 05 15:36:21.814993 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:21.814946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" event={"ID":"d8de78cc-6301-4ecc-a4a8-086750c2fa3b","Type":"ContainerStarted","Data":"4a1a6ffb52674215d81de0e15fca36be8616e512d674b25753241454d20b9dba"} Jun 05 15:36:21.816645 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:21.816609 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:36:21.817026 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:21.817004 2572 scope.go:117] "RemoveContainer" containerID="7d567244c9864aa54b371c2f06e9c9d809383b2c6a7ddd162ac2512b9ee43d8a" Jun 05 15:36:21.817207 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:21.817180 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-24b8p_openshift-console-operator(5b976f8b-9cc9-47f9-97ae-ee538a7ea318)\"" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" podUID="5b976f8b-9cc9-47f9-97ae-ee538a7ea318" Jun 05 15:36:22.607263 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.607188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:22.607397 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:22.607324 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:22.607397 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:22.607383 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls podName:0e4c5a07-6763-4bd6-af89-99e4aec8b2a7 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:30.60736986 +0000 UTC m=+260.016508408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j76wp" (UID: "0e4c5a07-6763-4bd6-af89-99e4aec8b2a7") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:22.637432 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.637405 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-pf844"] Jun 05 15:36:22.640391 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.640377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.642989 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.642971 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 05 15:36:22.644033 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.644009 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 05 15:36:22.644033 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.644023 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6c7w5\"" Jun 05 15:36:22.644195 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.644072 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 05 15:36:22.644195 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.644079 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 05 15:36:22.648831 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.648812 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-pf844"] Jun 05 15:36:22.708102 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.708075 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bcfb8952-eca0-4046-9a37-21b637c2d635-signing-key\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.708102 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.708103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhzg\" (UniqueName: \"kubernetes.io/projected/bcfb8952-eca0-4046-9a37-21b637c2d635-kube-api-access-drhzg\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.708254 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.708148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bcfb8952-eca0-4046-9a37-21b637c2d635-signing-cabundle\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.766688 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.766667 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j7c54_f284b810-0863-4c87-b40b-d33dcaa92cb7/node-ca/0.log" Jun 05 15:36:22.808554 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.808530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bcfb8952-eca0-4046-9a37-21b637c2d635-signing-key\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.808661 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.808561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drhzg\" (UniqueName: \"kubernetes.io/projected/bcfb8952-eca0-4046-9a37-21b637c2d635-kube-api-access-drhzg\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.808661 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.808653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bcfb8952-eca0-4046-9a37-21b637c2d635-signing-cabundle\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.809240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.809220 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bcfb8952-eca0-4046-9a37-21b637c2d635-signing-cabundle\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.810830 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.810806 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bcfb8952-eca0-4046-9a37-21b637c2d635-signing-key\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.816368 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.816346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhzg\" (UniqueName: \"kubernetes.io/projected/bcfb8952-eca0-4046-9a37-21b637c2d635-kube-api-access-drhzg\") pod \"service-ca-7d74d578b8-pf844\" (UID: \"bcfb8952-eca0-4046-9a37-21b637c2d635\") " pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:22.821706 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.821683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" event={"ID":"d8de78cc-6301-4ecc-a4a8-086750c2fa3b","Type":"ContainerStarted","Data":"4efcee1037ed74878da9422bdacb14496c8fea43358c7dc2a0c3978893437a5d"} Jun 05 15:36:22.821801 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.821741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" event={"ID":"d8de78cc-6301-4ecc-a4a8-086750c2fa3b","Type":"ContainerStarted","Data":"b65d8571f0e2152a6f2b0788d6cd92135c800a325f81357774c6cc048ccc88c7"} Jun 05 15:36:22.838889 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.838852 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kcgvj" podStartSLOduration=1.931033566 podStartE2EDuration="2.838839594s" totalImagesPullingTime="907.806028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:22.838198476 +0000 UTC m=+252.247337045" watchObservedRunningTime="2026-06-05 15:36:22.838839594 +0000 UTC m=+252.247978181" Jun 05 15:36:22.909287 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.909234 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:36:22.909479 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:22.909350 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:36:22.909479 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:22.909415 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs podName:44c3fb43-2064-4313-bcec-49d65a2676da nodeName:}" failed. No retries permitted until 2026-06-05 15:38:24.909399731 +0000 UTC m=+374.318538280 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs") pod "network-metrics-daemon-8wl98" (UID: "44c3fb43-2064-4313-bcec-49d65a2676da") : secret "metrics-daemon-secret" not found Jun 05 15:36:22.949400 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:22.949370 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-pf844" Jun 05 15:36:23.067543 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:23.067514 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-pf844"] Jun 05 15:36:23.071562 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:23.071538 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfb8952_eca0_4046_9a37_21b637c2d635.slice/crio-0ebda5eabd397b3250f4a7ef2cbf42f4b1990322f37d5fad9dff1ec4fed6318c WatchSource:0}: Error finding container 0ebda5eabd397b3250f4a7ef2cbf42f4b1990322f37d5fad9dff1ec4fed6318c: Status 404 returned error can't find the container with id 0ebda5eabd397b3250f4a7ef2cbf42f4b1990322f37d5fad9dff1ec4fed6318c Jun 05 15:36:23.569138 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:23.569108 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtgzv_39a9c053-831e-4872-8741-77156dedbd94/serve-healthcheck-canary/0.log" Jun 05 15:36:23.826057 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:23.825960 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-pf844" event={"ID":"bcfb8952-eca0-4046-9a37-21b637c2d635","Type":"ContainerStarted","Data":"0244da06411436e5fa487855bdec19d1d2f25115803c2b3a16cfdee99959b273"} Jun 05 15:36:23.826057 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:23.826027 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-pf844" event={"ID":"bcfb8952-eca0-4046-9a37-21b637c2d635","Type":"ContainerStarted","Data":"0ebda5eabd397b3250f4a7ef2cbf42f4b1990322f37d5fad9dff1ec4fed6318c"} Jun 05 15:36:23.845691 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:23.845644 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-pf844" podStartSLOduration=1.845610691 podStartE2EDuration="1.845610691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:23.84520704 +0000 UTC m=+253.254345631" watchObservedRunningTime="2026-06-05 15:36:23.845610691 +0000 UTC m=+253.254749260" Jun 05 15:36:25.110320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:25.110239 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:25.110320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:25.110298 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:25.110836 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:25.110683 2572 scope.go:117] "RemoveContainer" containerID="7d567244c9864aa54b371c2f06e9c9d809383b2c6a7ddd162ac2512b9ee43d8a" Jun 05 15:36:25.110909 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:25.110881 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-24b8p_openshift-console-operator(5b976f8b-9cc9-47f9-97ae-ee538a7ea318)\"" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" podUID="5b976f8b-9cc9-47f9-97ae-ee538a7ea318" Jun 05 15:36:30.667370 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:30.667329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:30.667840 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:30.667497 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:30.667840 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:30.667575 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls podName:0e4c5a07-6763-4bd6-af89-99e4aec8b2a7 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:46.667555621 +0000 UTC m=+276.076694184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j76wp" (UID: "0e4c5a07-6763-4bd6-af89-99e4aec8b2a7") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:36:40.084517 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:40.084489 2572 scope.go:117] "RemoveContainer" containerID="7d567244c9864aa54b371c2f06e9c9d809383b2c6a7ddd162ac2512b9ee43d8a" Jun 05 15:36:40.877770 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:40.876947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:36:40.877770 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:40.877023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" event={"ID":"5b976f8b-9cc9-47f9-97ae-ee538a7ea318","Type":"ContainerStarted","Data":"59f46ee4f2703eb46f0c60b0dc0b3adeeb31b56ad88d0ebed052404d5eba1a0e"} Jun 05 15:36:40.877770 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:40.877684 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:40.882737 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:40.882713 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" Jun 05 15:36:40.896754 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:40.896678 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-24b8p" podStartSLOduration=23.326615536 podStartE2EDuration="26.896660326s" totalImagesPullingTime="3.57004479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:40.896029797 +0000 UTC m=+270.305168367" watchObservedRunningTime="2026-06-05 15:36:40.896660326 +0000 UTC m=+270.305798895" Jun 05 15:36:43.425393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.425366 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tmdlm"] Jun 05 15:36:43.428545 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.428522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.431127 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.431100 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m25tm\"" Jun 05 15:36:43.432126 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.432109 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 15:36:43.432199 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.432129 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 15:36:43.442852 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.442828 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tmdlm"] Jun 05 15:36:43.465220 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.465194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df71b1f0-d122-4d9e-a7d5-70f015b6555e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.465322 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.465250 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df71b1f0-d122-4d9e-a7d5-70f015b6555e-data-volume\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.465322 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.465286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv5nn\" (UniqueName: \"kubernetes.io/projected/df71b1f0-d122-4d9e-a7d5-70f015b6555e-kube-api-access-vv5nn\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.465427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.465368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df71b1f0-d122-4d9e-a7d5-70f015b6555e-crio-socket\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.465427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.465409 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df71b1f0-d122-4d9e-a7d5-70f015b6555e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.566504 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.566473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df71b1f0-d122-4d9e-a7d5-70f015b6555e-crio-socket\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.566663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.566519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df71b1f0-d122-4d9e-a7d5-70f015b6555e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.566663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.566591 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df71b1f0-d122-4d9e-a7d5-70f015b6555e-crio-socket\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.566789 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.566682 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df71b1f0-d122-4d9e-a7d5-70f015b6555e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.566849 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.566800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df71b1f0-d122-4d9e-a7d5-70f015b6555e-data-volume\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.566903 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.566850 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5nn\" (UniqueName: \"kubernetes.io/projected/df71b1f0-d122-4d9e-a7d5-70f015b6555e-kube-api-access-vv5nn\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.567138 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.567107 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df71b1f0-d122-4d9e-a7d5-70f015b6555e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.567251 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.567164 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df71b1f0-d122-4d9e-a7d5-70f015b6555e-data-volume\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.569289 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.569266 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df71b1f0-d122-4d9e-a7d5-70f015b6555e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.580611 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.580588 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv5nn\" (UniqueName: \"kubernetes.io/projected/df71b1f0-d122-4d9e-a7d5-70f015b6555e-kube-api-access-vv5nn\") pod \"insights-runtime-extractor-tmdlm\" (UID: \"df71b1f0-d122-4d9e-a7d5-70f015b6555e\") " pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.738099 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.738032 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tmdlm" Jun 05 15:36:43.865339 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.865313 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tmdlm"] Jun 05 15:36:43.868639 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:43.868588 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf71b1f0_d122_4d9e_a7d5_70f015b6555e.slice/crio-45387ddced60e4ea900d3e22882b2065243c95a19adc1c5e20d76b866f4c6b9d WatchSource:0}: Error finding container 45387ddced60e4ea900d3e22882b2065243c95a19adc1c5e20d76b866f4c6b9d: Status 404 returned error can't find the container with id 45387ddced60e4ea900d3e22882b2065243c95a19adc1c5e20d76b866f4c6b9d Jun 05 15:36:43.887490 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:43.887468 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tmdlm" event={"ID":"df71b1f0-d122-4d9e-a7d5-70f015b6555e","Type":"ContainerStarted","Data":"45387ddced60e4ea900d3e22882b2065243c95a19adc1c5e20d76b866f4c6b9d"} Jun 05 15:36:44.892316 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:44.892286 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tmdlm" event={"ID":"df71b1f0-d122-4d9e-a7d5-70f015b6555e","Type":"ContainerStarted","Data":"f8153c803a7347eb41bc051bfb02b88e81dd6c02eb0301edbe3815dec12f5c3d"} Jun 05 15:36:44.892713 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:44.892349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tmdlm" event={"ID":"df71b1f0-d122-4d9e-a7d5-70f015b6555e","Type":"ContainerStarted","Data":"ffddc6fcb8598f10033a9d655ea676ef59bf9e4a49ef773bc3d4fd6c2e106da7"} Jun 05 15:36:46.694250 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:46.694212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:46.696553 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:46.696530 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e4c5a07-6763-4bd6-af89-99e4aec8b2a7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j76wp\" (UID: \"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:46.890785 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:46.890753 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" Jun 05 15:36:46.900327 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:46.900297 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tmdlm" event={"ID":"df71b1f0-d122-4d9e-a7d5-70f015b6555e","Type":"ContainerStarted","Data":"77708e1c3bf7c013d87995e400817b75cc6830653ad553cf07d58b397ea64c67"} Jun 05 15:36:46.920504 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:46.920458 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tmdlm" podStartSLOduration=1.939497461 podStartE2EDuration="3.920442631s" totalImagesPullingTime="1.98094517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:36:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:46.918784256 +0000 UTC m=+276.327922837" watchObservedRunningTime="2026-06-05 15:36:46.920442631 +0000 UTC m=+276.329581202" Jun 05 15:36:47.017135 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:47.017108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp"] Jun 05 15:36:47.020370 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:47.020348 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4c5a07_6763_4bd6_af89_99e4aec8b2a7.slice/crio-5f09cafbac35ecdc3bf36f18d4384e9e564d69a645678b96d38ac91281be7fb9 WatchSource:0}: Error finding container 5f09cafbac35ecdc3bf36f18d4384e9e564d69a645678b96d38ac91281be7fb9: Status 404 returned error can't find the container with id 5f09cafbac35ecdc3bf36f18d4384e9e564d69a645678b96d38ac91281be7fb9 Jun 05 15:36:47.904113 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:47.904076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" event={"ID":"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7","Type":"ContainerStarted","Data":"5f09cafbac35ecdc3bf36f18d4384e9e564d69a645678b96d38ac91281be7fb9"} Jun 05 15:36:48.562495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.562460 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c5794566-b2b5h"] Jun 05 15:36:48.565710 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.565687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.568190 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.568166 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 15:36:48.568280 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.568204 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 15:36:48.568350 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.568333 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 15:36:48.569439 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.569410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 15:36:48.569439 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.569429 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 15:36:48.569596 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.569441 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 15:36:48.569596 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.569496 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 15:36:48.569596 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.569498 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mntt7\"" Jun 05 15:36:48.575814 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.575794 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5794566-b2b5h"] Jun 05 15:36:48.610803 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.610769 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-serving-cert\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.610963 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.610830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-oauth-config\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.610963 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.610859 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gblqs\" (UniqueName: \"kubernetes.io/projected/e62e50bb-565f-44a1-ba88-5e7b0684172b-kube-api-access-gblqs\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.610963 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.610886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-service-ca\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.611098 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.610993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-config\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.611098 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.611080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-oauth-serving-cert\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.712362 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.712323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-serving-cert\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.712549 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.712394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-oauth-config\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.712549 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.712423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gblqs\" (UniqueName: \"kubernetes.io/projected/e62e50bb-565f-44a1-ba88-5e7b0684172b-kube-api-access-gblqs\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.712549 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.712452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-service-ca\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.712549 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.712540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-config\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.712784 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.712586 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-oauth-serving-cert\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.713337 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.713284 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-config\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.713337 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.713325 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-service-ca\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.713507 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.713291 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-oauth-serving-cert\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.715094 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.715064 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-serving-cert\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.715267 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.715243 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-oauth-config\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.720057 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.720037 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gblqs\" (UniqueName: \"kubernetes.io/projected/e62e50bb-565f-44a1-ba88-5e7b0684172b-kube-api-access-gblqs\") pod \"console-7c5794566-b2b5h\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:48.876524 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:48.876476 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:49.194089 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:49.194062 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5794566-b2b5h"] Jun 05 15:36:49.197204 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:49.197177 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62e50bb_565f_44a1_ba88_5e7b0684172b.slice/crio-257c64784c618976255093271fbbac830fd7e9dcdf1577ba5b29b428fdaf29f3 WatchSource:0}: Error finding container 257c64784c618976255093271fbbac830fd7e9dcdf1577ba5b29b428fdaf29f3: Status 404 returned error can't find the container with id 257c64784c618976255093271fbbac830fd7e9dcdf1577ba5b29b428fdaf29f3 Jun 05 15:36:49.913498 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:49.913453 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" event={"ID":"0e4c5a07-6763-4bd6-af89-99e4aec8b2a7","Type":"ContainerStarted","Data":"4c5c94fea49c51a93ea51aaaa068ab00fdf6d9f47b2b2c861514f927354c22ab"} Jun 05 15:36:49.914787 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:49.914761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5794566-b2b5h" event={"ID":"e62e50bb-565f-44a1-ba88-5e7b0684172b","Type":"ContainerStarted","Data":"257c64784c618976255093271fbbac830fd7e9dcdf1577ba5b29b428fdaf29f3"} Jun 05 15:36:49.930522 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:49.930476 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j76wp" podStartSLOduration=33.838300049 podStartE2EDuration="35.930460386s" totalImagesPullingTime="2.092160337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:49.929978245 +0000 UTC m=+279.339116813" watchObservedRunningTime="2026-06-05 15:36:49.930460386 +0000 UTC m=+279.339598954" Jun 05 15:36:51.573450 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:51.573408 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" podUID="03cbd584-f698-47be-b8db-30a25820e978" Jun 05 15:36:51.573450 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:51.573409 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" Jun 05 15:36:51.573919 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:51.573409 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lfdf2" podUID="de0874a1-c310-49ce-bfe0-067200199f9b" Jun 05 15:36:51.921421 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:51.921392 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfdf2" Jun 05 15:36:51.921571 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:51.921392 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:36:51.921571 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:51.921401 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:36:52.696305 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.696272 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg"] Jun 05 15:36:52.716937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.716911 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg"] Jun 05 15:36:52.717076 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.717009 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.719757 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.719738 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 15:36:52.720784 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.720763 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 15:36:52.720899 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.720765 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 15:36:52.720899 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.720771 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m4p9q\"" Jun 05 15:36:52.851643 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.851601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.851790 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.851656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.851790 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.851745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2gz5\" (UniqueName: \"kubernetes.io/projected/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-kube-api-access-g2gz5\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.851860 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.851811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.926575 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.926539 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5794566-b2b5h" event={"ID":"e62e50bb-565f-44a1-ba88-5e7b0684172b","Type":"ContainerStarted","Data":"38d8d81260fee95d35ca2c3ecaa6aa69469a197c5d5c29102cc49e613029a23a"} Jun 05 15:36:52.952722 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.952486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.952722 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.952544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.952722 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.952569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.952722 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:52.952653 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 05 15:36:52.952722 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:52.952721 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-tls podName:af9c4e34-b1c0-4ac8-acd2-2b7e707941c0 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:53.452703383 +0000 UTC m=+282.861841954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-8x4zg" (UID: "af9c4e34-b1c0-4ac8-acd2-2b7e707941c0") : secret "prometheus-operator-tls" not found Jun 05 15:36:52.953092 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.952656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2gz5\" (UniqueName: \"kubernetes.io/projected/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-kube-api-access-g2gz5\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.953409 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.953385 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.955237 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.955217 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:52.962786 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:52.962767 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2gz5\" (UniqueName: \"kubernetes.io/projected/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-kube-api-access-g2gz5\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:53.457832 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:53.457796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:53.460182 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:53.460147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9c4e34-b1c0-4ac8-acd2-2b7e707941c0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-8x4zg\" (UID: \"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:53.631158 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:53.631128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" Jun 05 15:36:53.768410 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:53.768345 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c5794566-b2b5h" podStartSLOduration=2.761700068 podStartE2EDuration="5.768321903s" totalImagesPullingTime="3.006621835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:52.948181431 +0000 UTC m=+282.357319993" watchObservedRunningTime="2026-06-05 15:36:53.768321903 +0000 UTC m=+283.177460473" Jun 05 15:36:53.769213 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:53.769193 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg"] Jun 05 15:36:53.772032 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:53.772012 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9c4e34_b1c0_4ac8_acd2_2b7e707941c0.slice/crio-5ce4d9d758bcaf6a9f3dc26f2ab31ba13e2719e028ac020e982b38711d06e61a WatchSource:0}: Error finding container 5ce4d9d758bcaf6a9f3dc26f2ab31ba13e2719e028ac020e982b38711d06e61a: Status 404 returned error can't find the container with id 5ce4d9d758bcaf6a9f3dc26f2ab31ba13e2719e028ac020e982b38711d06e61a Jun 05 15:36:53.931235 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:53.931201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" event={"ID":"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0","Type":"ContainerStarted","Data":"5ce4d9d758bcaf6a9f3dc26f2ab31ba13e2719e028ac020e982b38711d06e61a"} Jun 05 15:36:55.373150 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.373123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:36:55.373500 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.373168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:36:55.375515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.375486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"image-registry-fc7f5d48d-9cr8f\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:36:55.375619 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.375512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03cbd584-f698-47be-b8db-30a25820e978-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rl7x7\" (UID: \"03cbd584-f698-47be-b8db-30a25820e978\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:36:55.473965 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.473935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:36:55.476384 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.476359 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de0874a1-c310-49ce-bfe0-067200199f9b-metrics-tls\") pod \"dns-default-lfdf2\" (UID: \"de0874a1-c310-49ce-bfe0-067200199f9b\") " pod="openshift-dns/dns-default-lfdf2" Jun 05 15:36:55.526412 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.526390 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lstm9\"" Jun 05 15:36:55.526412 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.526410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jcmnr\"" Jun 05 15:36:55.526550 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.526390 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5jhbv\"" Jun 05 15:36:55.532677 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.532659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfdf2" Jun 05 15:36:55.532747 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.532707 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" Jun 05 15:36:55.532747 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.532707 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:36:55.682652 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.682600 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lfdf2"] Jun 05 15:36:55.686856 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:55.686833 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde0874a1_c310_49ce_bfe0_067200199f9b.slice/crio-6c6ff1ffc7144c69c74fb9b41bbeec0004cea61453dc01fe78024c49855f4c84 WatchSource:0}: Error finding container 6c6ff1ffc7144c69c74fb9b41bbeec0004cea61453dc01fe78024c49855f4c84: Status 404 returned error can't find the container with id 6c6ff1ffc7144c69c74fb9b41bbeec0004cea61453dc01fe78024c49855f4c84 Jun 05 15:36:55.902815 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.902790 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7"] Jun 05 15:36:55.905202 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:55.905172 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cbd584_f698_47be_b8db_30a25820e978.slice/crio-f172a751cfb784401ac54b304669757040ff4a3389134999e9cd8cec3f4a850d WatchSource:0}: Error finding container f172a751cfb784401ac54b304669757040ff4a3389134999e9cd8cec3f4a850d: Status 404 returned error can't find the container with id f172a751cfb784401ac54b304669757040ff4a3389134999e9cd8cec3f4a850d Jun 05 15:36:55.905845 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.905824 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc7f5d48d-9cr8f"] Jun 05 15:36:55.909314 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:55.909287 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15e90e1_6655_4ac0_82f6_e0c2e973a3f0.slice/crio-9d01fa59803432cf99d2af397e4ad2a9847d3187035dbae28451dc9e1bd57acb WatchSource:0}: Error finding container 9d01fa59803432cf99d2af397e4ad2a9847d3187035dbae28451dc9e1bd57acb: Status 404 returned error can't find the container with id 9d01fa59803432cf99d2af397e4ad2a9847d3187035dbae28451dc9e1bd57acb Jun 05 15:36:55.938221 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.938197 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" event={"ID":"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0","Type":"ContainerStarted","Data":"9d01fa59803432cf99d2af397e4ad2a9847d3187035dbae28451dc9e1bd57acb"} Jun 05 15:36:55.939221 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.939200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" event={"ID":"03cbd584-f698-47be-b8db-30a25820e978","Type":"ContainerStarted","Data":"f172a751cfb784401ac54b304669757040ff4a3389134999e9cd8cec3f4a850d"} Jun 05 15:36:55.940134 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.940109 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfdf2" event={"ID":"de0874a1-c310-49ce-bfe0-067200199f9b","Type":"ContainerStarted","Data":"6c6ff1ffc7144c69c74fb9b41bbeec0004cea61453dc01fe78024c49855f4c84"} Jun 05 15:36:55.941563 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.941542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" event={"ID":"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0","Type":"ContainerStarted","Data":"99e8ea60a082bf735ae8118173a609324876271200085ec7d60f01d032c462cb"} Jun 05 15:36:55.941674 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.941587 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" event={"ID":"af9c4e34-b1c0-4ac8-acd2-2b7e707941c0","Type":"ContainerStarted","Data":"1d10133aabbf65fa170d7d427739f5bcedf83d5f90a41431c982d0d463979a68"} Jun 05 15:36:55.959745 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:55.959708 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-8x4zg" podStartSLOduration=2.759405773 podStartE2EDuration="3.959694986s" totalImagesPullingTime="1.200289213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:55.958741099 +0000 UTC m=+285.367879673" watchObservedRunningTime="2026-06-05 15:36:55.959694986 +0000 UTC m=+285.368833553" Jun 05 15:36:56.947321 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:56.947282 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" event={"ID":"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0","Type":"ContainerStarted","Data":"ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0"} Jun 05 15:36:56.947756 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:56.947439 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:36:56.972250 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:56.972193 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" podStartSLOduration=263.972174398 podStartE2EDuration="4m23.972174398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:56.971925062 +0000 UTC m=+286.381063649" watchObservedRunningTime="2026-06-05 15:36:56.972174398 +0000 UTC m=+286.381312967" Jun 05 15:36:57.952100 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:57.952062 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" event={"ID":"03cbd584-f698-47be-b8db-30a25820e978","Type":"ContainerStarted","Data":"fab4f8153a0dd759975d7556b4478ac33fb454fd44470d198e1ee37c643f79c4"} Jun 05 15:36:57.953900 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:57.953871 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfdf2" event={"ID":"de0874a1-c310-49ce-bfe0-067200199f9b","Type":"ContainerStarted","Data":"b95e7b2dc7cf649731cc7eb3b1aaf775e953633082380ca5b4fcefa4ab953c65"} Jun 05 15:36:57.954025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:57.953916 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfdf2" event={"ID":"de0874a1-c310-49ce-bfe0-067200199f9b","Type":"ContainerStarted","Data":"4b331463a8d926b68a128a5e413c94ef2e8477a83c4ba587f35a3bbd9296fe15"} Jun 05 15:36:57.954025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:57.953944 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lfdf2" Jun 05 15:36:57.974078 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:57.973998 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rl7x7" podStartSLOduration=278.884174286 podStartE2EDuration="4m39.973975507s" totalImagesPullingTime="1.089801221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:57.972535671 +0000 UTC m=+287.381674240" watchObservedRunningTime="2026-06-05 15:36:57.973975507 +0000 UTC m=+287.383114075" Jun 05 15:36:57.990352 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:57.990266 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lfdf2" podStartSLOduration=250.960900407 podStartE2EDuration="4m12.990247317s" totalImagesPullingTime="2.02934691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:57.989769998 +0000 UTC m=+287.398908567" watchObservedRunningTime="2026-06-05 15:36:57.990247317 +0000 UTC m=+287.399385886" Jun 05 15:36:58.082899 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.082869 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv"] Jun 05 15:36:58.086075 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.086058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.089016 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.088982 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 15:36:58.089109 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.089057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-78hmt\"" Jun 05 15:36:58.089528 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.089477 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 15:36:58.090146 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.090122 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 15:36:58.120415 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.120394 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv"] Jun 05 15:36:58.144285 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.144264 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5jfpr"] Jun 05 15:36:58.147411 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.147394 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.150264 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.150246 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 15:36:58.150349 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.150287 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vfrt5\"" Jun 05 15:36:58.150560 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.150542 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 15:36:58.159280 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.159264 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 15:36:58.196515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.196494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be3acbf6-a562-42f2-8527-575195e0fee7-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.196622 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.196533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.196622 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.196550 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2zd\" (UniqueName: \"kubernetes.io/projected/be3acbf6-a562-42f2-8527-575195e0fee7-kube-api-access-tm2zd\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.196622 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.196572 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.196622 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.196615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.196854 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.196706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3acbf6-a562-42f2-8527-575195e0fee7-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.297902 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.297829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.297902 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.297872 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2zd\" (UniqueName: \"kubernetes.io/projected/be3acbf6-a562-42f2-8527-575195e0fee7-kube-api-access-tm2zd\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.298101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.297904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.298101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.297931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-metrics-client-ca\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.297960 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.298101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.297990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-wtmp\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298074 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298120 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3acbf6-a562-42f2-8527-575195e0fee7-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.298328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-657lt\" (UniqueName: \"kubernetes.io/projected/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-kube-api-access-657lt\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-root\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-textfile\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298560 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298360 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-tls\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298560 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be3acbf6-a562-42f2-8527-575195e0fee7-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.298560 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-sys\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.298716 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298622 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.298716 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:58.298684 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 15:36:58.298819 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298735 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be3acbf6-a562-42f2-8527-575195e0fee7-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.298819 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:36:58.298753 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-tls podName:be3acbf6-a562-42f2-8527-575195e0fee7 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:58.798733241 +0000 UTC m=+288.207871794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-2kfdv" (UID: "be3acbf6-a562-42f2-8527-575195e0fee7") : secret "kube-state-metrics-tls" not found Jun 05 15:36:58.298819 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.298777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3acbf6-a562-42f2-8527-575195e0fee7-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.300905 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.300874 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.307920 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.307890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2zd\" (UniqueName: \"kubernetes.io/projected/be3acbf6-a562-42f2-8527-575195e0fee7-kube-api-access-tm2zd\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.399619 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-sys\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-metrics-client-ca\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399681 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-wtmp\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-sys\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-657lt\" (UniqueName: \"kubernetes.io/projected/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-kube-api-access-657lt\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-root\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.399958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399879 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-root\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.400151 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.399999 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-wtmp\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.400151 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.400030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-textfile\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.400151 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.400068 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-tls\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.400350 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.400306 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-metrics-client-ca\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.400404 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.400346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.400404 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.400372 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-textfile\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.401908 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.401884 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.402264 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.402245 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-node-exporter-tls\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.408222 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.408196 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-657lt\" (UniqueName: \"kubernetes.io/projected/0ddcebd9-0ef3-4352-a716-2d5335b6a71b-kube-api-access-657lt\") pod \"node-exporter-5jfpr\" (UID: \"0ddcebd9-0ef3-4352-a716-2d5335b6a71b\") " pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.457046 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.457019 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5jfpr" Jun 05 15:36:58.803598 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.803566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.806033 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.806010 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be3acbf6-a562-42f2-8527-575195e0fee7-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2kfdv\" (UID: \"be3acbf6-a562-42f2-8527-575195e0fee7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:58.877262 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.877237 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:58.877382 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.877289 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:36:58.878535 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.878505 2572 patch_prober.go:28] interesting pod/console-7c5794566-b2b5h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jun 05 15:36:58.878636 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.878547 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c5794566-b2b5h" podUID="e62e50bb-565f-44a1-ba88-5e7b0684172b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" Jun 05 15:36:58.959918 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.959882 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5jfpr" event={"ID":"0ddcebd9-0ef3-4352-a716-2d5335b6a71b","Type":"ContainerStarted","Data":"522bcb2c2e07ce5b7fc801a2792772b1f8c5632694335ee67fc69e4eddf3add5"} Jun 05 15:36:58.996718 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:58.996686 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" Jun 05 15:36:59.179164 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.179130 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv"] Jun 05 15:36:59.189737 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.189710 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:36:59.194783 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.194758 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.197658 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.197587 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 15:36:59.198807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.198497 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 15:36:59.198807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.198775 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 15:36:59.199032 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.199012 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 15:36:59.199092 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.199047 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 15:36:59.199255 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.199236 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 15:36:59.199318 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.199291 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hvsl2\"" Jun 05 15:36:59.199618 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.199599 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 15:36:59.200036 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.199753 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 15:36:59.200036 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.199891 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 15:36:59.218273 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.218249 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:36:59.307680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.307680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.307872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307700 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dc324e3-00da-4d2f-ad55-72e6812f5e45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.307872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w85hw\" (UniqueName: \"kubernetes.io/projected/6dc324e3-00da-4d2f-ad55-72e6812f5e45-kube-api-access-w85hw\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.307872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dc324e3-00da-4d2f-ad55-72e6812f5e45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.307872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dc324e3-00da-4d2f-ad55-72e6812f5e45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.307872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-web-config\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.307872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.308274 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dc324e3-00da-4d2f-ad55-72e6812f5e45-config-out\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.308274 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.308274 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.307955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.308274 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.308043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dc324e3-00da-4d2f-ad55-72e6812f5e45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.308274 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.308081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.394095 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:59.394061 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3acbf6_a562_42f2_8527_575195e0fee7.slice/crio-2b0869388c71d7dad630c0086618cb632c7bb3af5137dd5249b09a8c5d1c9a18 WatchSource:0}: Error finding container 2b0869388c71d7dad630c0086618cb632c7bb3af5137dd5249b09a8c5d1c9a18: Status 404 returned error can't find the container with id 2b0869388c71d7dad630c0086618cb632c7bb3af5137dd5249b09a8c5d1c9a18 Jun 05 15:36:59.408468 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408443 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408494 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dc324e3-00da-4d2f-ad55-72e6812f5e45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w85hw\" (UniqueName: \"kubernetes.io/projected/6dc324e3-00da-4d2f-ad55-72e6812f5e45-kube-api-access-w85hw\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408663 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dc324e3-00da-4d2f-ad55-72e6812f5e45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dc324e3-00da-4d2f-ad55-72e6812f5e45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-web-config\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dc324e3-00da-4d2f-ad55-72e6812f5e45-config-out\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.408813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.409050 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.409050 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408846 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dc324e3-00da-4d2f-ad55-72e6812f5e45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.409050 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dc324e3-00da-4d2f-ad55-72e6812f5e45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.409050 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.408887 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.410731 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.410704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dc324e3-00da-4d2f-ad55-72e6812f5e45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.411298 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.411274 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dc324e3-00da-4d2f-ad55-72e6812f5e45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.412230 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.412186 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.412396 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.412355 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dc324e3-00da-4d2f-ad55-72e6812f5e45-config-out\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.413272 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.413094 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-web-config\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.413272 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.413259 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.413968 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.413773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dc324e3-00da-4d2f-ad55-72e6812f5e45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.413968 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.413928 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.414121 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.413996 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.414408 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.414389 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.415193 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.415152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dc324e3-00da-4d2f-ad55-72e6812f5e45-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.416865 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.416845 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w85hw\" (UniqueName: \"kubernetes.io/projected/6dc324e3-00da-4d2f-ad55-72e6812f5e45-kube-api-access-w85hw\") pod \"alertmanager-main-0\" (UID: \"6dc324e3-00da-4d2f-ad55-72e6812f5e45\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.507711 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.507687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:36:59.645890 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.645859 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:36:59.648881 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:36:59.648846 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc324e3_00da_4d2f_ad55_72e6812f5e45.slice/crio-131e3306e7dc1656afd2605a98c144e79bffcafb78a561f7bf7c3f953a02782d WatchSource:0}: Error finding container 131e3306e7dc1656afd2605a98c144e79bffcafb78a561f7bf7c3f953a02782d: Status 404 returned error can't find the container with id 131e3306e7dc1656afd2605a98c144e79bffcafb78a561f7bf7c3f953a02782d Jun 05 15:36:59.968490 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.968450 2572 generic.go:356] "Generic (PLEG): container finished" podID="0ddcebd9-0ef3-4352-a716-2d5335b6a71b" containerID="39e6153a30ac8105fe6cd5fa3e48ba2fa073a0f80a049b902eba2b986397d3a7" exitCode=0 Jun 05 15:36:59.968959 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.968561 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5jfpr" event={"ID":"0ddcebd9-0ef3-4352-a716-2d5335b6a71b","Type":"ContainerDied","Data":"39e6153a30ac8105fe6cd5fa3e48ba2fa073a0f80a049b902eba2b986397d3a7"} Jun 05 15:36:59.970129 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.970049 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerStarted","Data":"131e3306e7dc1656afd2605a98c144e79bffcafb78a561f7bf7c3f953a02782d"} Jun 05 15:36:59.971573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:36:59.971514 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" event={"ID":"be3acbf6-a562-42f2-8527-575195e0fee7","Type":"ContainerStarted","Data":"2b0869388c71d7dad630c0086618cb632c7bb3af5137dd5249b09a8c5d1c9a18"} Jun 05 15:37:00.979364 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:00.978839 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5jfpr" event={"ID":"0ddcebd9-0ef3-4352-a716-2d5335b6a71b","Type":"ContainerStarted","Data":"f9602650d19c4c6babd18b07803d9f758def77ce39e762eab26ee4b2f582c144"} Jun 05 15:37:00.979364 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:00.978899 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5jfpr" event={"ID":"0ddcebd9-0ef3-4352-a716-2d5335b6a71b","Type":"ContainerStarted","Data":"9dad7193ae6c96df3208138d28611122ec23b6fcb8fbe4fb057c0dd34cff2d48"} Jun 05 15:37:01.000400 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:01.000175 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5jfpr" podStartSLOduration=1.962607179 podStartE2EDuration="3.000155935s" totalImagesPullingTime="965.992255ms" totalInitContainerRuntime="71.556501ms" isStatefulPod=true podCreationTimestamp="2026-06-05 15:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:00.997737031 +0000 UTC m=+290.406875600" watchObservedRunningTime="2026-06-05 15:37:01.000155935 +0000 UTC m=+290.409294519" Jun 05 15:37:01.987287 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:01.987254 2572 generic.go:356] "Generic (PLEG): container finished" podID="6dc324e3-00da-4d2f-ad55-72e6812f5e45" containerID="50a35e39d8b082264fc79fc31129ba178560b857ac254c70823548bc946783e5" exitCode=0 Jun 05 15:37:01.987847 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:01.987336 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerDied","Data":"50a35e39d8b082264fc79fc31129ba178560b857ac254c70823548bc946783e5"} Jun 05 15:37:01.989581 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:01.989557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" event={"ID":"be3acbf6-a562-42f2-8527-575195e0fee7","Type":"ContainerStarted","Data":"b3e74868c9d5fd38ee308f976369bcb22bb4bf7685beb5e8c4adedc47b963b54"} Jun 05 15:37:01.989663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:01.989615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" event={"ID":"be3acbf6-a562-42f2-8527-575195e0fee7","Type":"ContainerStarted","Data":"3845ec895857ba8667a7e40d6008553cef1e70302a73b9c06c224ed4108481a4"} Jun 05 15:37:01.989707 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:01.989667 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" event={"ID":"be3acbf6-a562-42f2-8527-575195e0fee7","Type":"ContainerStarted","Data":"7c9d0ff6b41e0618517130153e17622030a4b67e62b5333673b1fd32d3d0a4b8"} Jun 05 15:37:02.035088 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:02.035030 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2kfdv" podStartSLOduration=2.493228399 podStartE2EDuration="4.035011917s" totalImagesPullingTime="1.541783518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:02.034459236 +0000 UTC m=+291.443597804" watchObservedRunningTime="2026-06-05 15:37:02.035011917 +0000 UTC m=+291.444150486" Jun 05 15:37:02.964293 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:02.964256 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5794566-b2b5h"] Jun 05 15:37:04.001222 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:04.001196 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerStarted","Data":"dba5b56f9e652fd4b3af439da70d03a647364b0ed6cbf46e003879cc62ee81a8"} Jun 05 15:37:04.001495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:04.001259 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerStarted","Data":"7e0444bba874fa542f0f82c0ebb5fb0d3ada48b0d3a5fc480900245893b1f420"} Jun 05 15:37:04.001495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:04.001284 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerStarted","Data":"052ec02f074ef7a9faff32173e251caaa598498f976689157e7afeb4e4a13697"} Jun 05 15:37:04.001495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:04.001307 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerStarted","Data":"5ac817812931139136db98d9b25d958a8e53357bca88583c66a4854408fc255c"} Jun 05 15:37:05.013798 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:05.013711 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerStarted","Data":"e29795447afbc1c99a003deef6efbc97395f12a2269c206660618da86e559d3b"} Jun 05 15:37:05.014149 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:05.013798 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc324e3-00da-4d2f-ad55-72e6812f5e45","Type":"ContainerStarted","Data":"9be53ada4087f9779ff222c5360581fc78bd1025eb23b912ca2cc1ee8ddb9671"} Jun 05 15:37:05.040953 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:05.040910 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.31186425 podStartE2EDuration="6.040896253s" totalImagesPullingTime="3.704577591s" totalInitContainerRuntime="24.454412ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:05.040387743 +0000 UTC m=+294.449526333" watchObservedRunningTime="2026-06-05 15:37:05.040896253 +0000 UTC m=+294.450034821" Jun 05 15:37:07.084558 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:37:07.084518 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8wl98" podUID="44c3fb43-2064-4313-bcec-49d65a2676da" Jun 05 15:37:07.962946 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:07.962914 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lfdf2" Jun 05 15:37:10.439354 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.439320 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97fbbc5d-n77wz"] Jun 05 15:37:10.443229 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.443207 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.452835 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.452809 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 15:37:10.457382 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.457354 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97fbbc5d-n77wz"] Jun 05 15:37:10.616960 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.616923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-trusted-ca-bundle\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.616960 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.616971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-oauth-serving-cert\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.617215 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.616999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr955\" (UniqueName: \"kubernetes.io/projected/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-kube-api-access-zr955\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.617215 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.617093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-serving-cert\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.617215 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.617126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-config\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.617215 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.617171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-oauth-config\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.617389 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.617228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-service-ca\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.718280 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.718164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-serving-cert\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.718280 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.718224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-config\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.718280 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.718258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-oauth-config\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.718546 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.718405 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-service-ca\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.718546 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.718500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-trusted-ca-bundle\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.718546 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.718518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-oauth-serving-cert\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.718546 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.718533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr955\" (UniqueName: \"kubernetes.io/projected/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-kube-api-access-zr955\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.719211 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.719184 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-config\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.719344 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.719184 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-service-ca\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.719401 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.719356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-oauth-serving-cert\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.719521 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.719494 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-trusted-ca-bundle\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.720925 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.720901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-oauth-config\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.721022 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.721001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-serving-cert\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.727818 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.727795 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr955\" (UniqueName: \"kubernetes.io/projected/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-kube-api-access-zr955\") pod \"console-97fbbc5d-n77wz\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.755139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.755107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:10.892474 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:10.892452 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97fbbc5d-n77wz"] Jun 05 15:37:10.894707 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:37:10.894674 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e30e27_12b4_4c36_b13d_dc56a6cc7a7f.slice/crio-f14d1f46082ba354c0170e11789434bbef287d5138422058ab07927dae67989c WatchSource:0}: Error finding container f14d1f46082ba354c0170e11789434bbef287d5138422058ab07927dae67989c: Status 404 returned error can't find the container with id f14d1f46082ba354c0170e11789434bbef287d5138422058ab07927dae67989c Jun 05 15:37:11.029092 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.029015 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:37:11.029233 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.029096 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:37:11.038483 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.038448 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fbbc5d-n77wz" event={"ID":"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f","Type":"ContainerStarted","Data":"db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078"} Jun 05 15:37:11.038620 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.038503 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fbbc5d-n77wz" event={"ID":"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f","Type":"ContainerStarted","Data":"f14d1f46082ba354c0170e11789434bbef287d5138422058ab07927dae67989c"} Jun 05 15:37:11.040497 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.040478 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:37:11.040497 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.040493 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:37:11.045519 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.045501 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 15:37:11.056740 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:11.056696 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97fbbc5d-n77wz" podStartSLOduration=1.056682711 podStartE2EDuration="1.056682711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:11.055760224 +0000 UTC m=+300.464898810" watchObservedRunningTime="2026-06-05 15:37:11.056682711 +0000 UTC m=+300.465821279" Jun 05 15:37:15.456561 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:15.456522 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc7f5d48d-9cr8f"] Jun 05 15:37:15.461304 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:15.461272 2572 patch_prober.go:28] interesting pod/image-registry-fc7f5d48d-9cr8f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:37:15.461445 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:15.461329 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:37:20.084218 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:20.084183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:37:20.755642 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:20.755605 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:20.755845 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:20.755679 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:20.760169 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:20.760146 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:21.080569 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:21.080496 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:37:25.091912 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:25.091832 2572 generic.go:356] "Generic (PLEG): container finished" podID="f80bf5dc-734b-46f9-84db-971664d9e2da" containerID="1c8f15f3a855a618099a25777ca7b476a352cf69116259f7fd107fb4a663b2eb" exitCode=0 Jun 05 15:37:25.092259 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:25.091904 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" event={"ID":"f80bf5dc-734b-46f9-84db-971664d9e2da","Type":"ContainerDied","Data":"1c8f15f3a855a618099a25777ca7b476a352cf69116259f7fd107fb4a663b2eb"} Jun 05 15:37:25.092259 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:25.092196 2572 scope.go:117] "RemoveContainer" containerID="1c8f15f3a855a618099a25777ca7b476a352cf69116259f7fd107fb4a663b2eb" Jun 05 15:37:25.461075 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:25.461046 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:37:26.097763 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:26.097730 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pr8bg" event={"ID":"f80bf5dc-734b-46f9-84db-971664d9e2da","Type":"ContainerStarted","Data":"85c80c9656f55fd12b89a5d4e7cefd7fe3ed993af79cb56af5daf92e785e5711"} Jun 05 15:37:27.988134 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:27.988073 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c5794566-b2b5h" podUID="e62e50bb-565f-44a1-ba88-5e7b0684172b" containerName="console" containerID="cri-o://38d8d81260fee95d35ca2c3ecaa6aa69469a197c5d5c29102cc49e613029a23a" gracePeriod=15 Jun 05 15:37:28.107200 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.107165 2572 generic.go:356] "Generic (PLEG): container finished" podID="e62e50bb-565f-44a1-ba88-5e7b0684172b" containerID="38d8d81260fee95d35ca2c3ecaa6aa69469a197c5d5c29102cc49e613029a23a" exitCode=0 Jun 05 15:37:28.107317 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.107230 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5794566-b2b5h" event={"ID":"e62e50bb-565f-44a1-ba88-5e7b0684172b","Type":"ContainerDied","Data":"38d8d81260fee95d35ca2c3ecaa6aa69469a197c5d5c29102cc49e613029a23a"} Jun 05 15:37:28.229509 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.229482 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:37:28.268896 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.268827 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-serving-cert\") pod \"e62e50bb-565f-44a1-ba88-5e7b0684172b\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " Jun 05 15:37:28.268896 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.268868 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-service-ca\") pod \"e62e50bb-565f-44a1-ba88-5e7b0684172b\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " Jun 05 15:37:28.269085 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269057 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-config\") pod \"e62e50bb-565f-44a1-ba88-5e7b0684172b\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " Jun 05 15:37:28.269140 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269121 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gblqs\" (UniqueName: \"kubernetes.io/projected/e62e50bb-565f-44a1-ba88-5e7b0684172b-kube-api-access-gblqs\") pod \"e62e50bb-565f-44a1-ba88-5e7b0684172b\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " Jun 05 15:37:28.269193 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269168 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-oauth-config\") pod \"e62e50bb-565f-44a1-ba88-5e7b0684172b\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " Jun 05 15:37:28.269243 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269211 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-oauth-serving-cert\") pod \"e62e50bb-565f-44a1-ba88-5e7b0684172b\" (UID: \"e62e50bb-565f-44a1-ba88-5e7b0684172b\") " Jun 05 15:37:28.269243 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269211 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-service-ca" (OuterVolumeSpecName: "service-ca") pod "e62e50bb-565f-44a1-ba88-5e7b0684172b" (UID: "e62e50bb-565f-44a1-ba88-5e7b0684172b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:37:28.269428 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269397 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-config" (OuterVolumeSpecName: "console-config") pod "e62e50bb-565f-44a1-ba88-5e7b0684172b" (UID: "e62e50bb-565f-44a1-ba88-5e7b0684172b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:37:28.269545 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269516 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-service-ca\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:28.269596 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269555 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-config\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:28.269804 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.269780 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e62e50bb-565f-44a1-ba88-5e7b0684172b" (UID: "e62e50bb-565f-44a1-ba88-5e7b0684172b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:37:28.271211 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.271178 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e62e50bb-565f-44a1-ba88-5e7b0684172b" (UID: "e62e50bb-565f-44a1-ba88-5e7b0684172b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:37:28.271309 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.271216 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e62e50bb-565f-44a1-ba88-5e7b0684172b-kube-api-access-gblqs" (OuterVolumeSpecName: "kube-api-access-gblqs") pod "e62e50bb-565f-44a1-ba88-5e7b0684172b" (UID: "e62e50bb-565f-44a1-ba88-5e7b0684172b"). InnerVolumeSpecName "kube-api-access-gblqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:37:28.271309 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.271247 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e62e50bb-565f-44a1-ba88-5e7b0684172b" (UID: "e62e50bb-565f-44a1-ba88-5e7b0684172b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:37:28.370846 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.370820 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gblqs\" (UniqueName: \"kubernetes.io/projected/e62e50bb-565f-44a1-ba88-5e7b0684172b-kube-api-access-gblqs\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:28.370846 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.370842 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-oauth-config\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:28.370987 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.370851 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e62e50bb-565f-44a1-ba88-5e7b0684172b-oauth-serving-cert\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:28.370987 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:28.370861 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e62e50bb-565f-44a1-ba88-5e7b0684172b-console-serving-cert\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:29.112228 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:29.112197 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5794566-b2b5h" Jun 05 15:37:29.112693 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:29.112204 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5794566-b2b5h" event={"ID":"e62e50bb-565f-44a1-ba88-5e7b0684172b","Type":"ContainerDied","Data":"257c64784c618976255093271fbbac830fd7e9dcdf1577ba5b29b428fdaf29f3"} Jun 05 15:37:29.112693 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:29.112336 2572 scope.go:117] "RemoveContainer" containerID="38d8d81260fee95d35ca2c3ecaa6aa69469a197c5d5c29102cc49e613029a23a" Jun 05 15:37:29.128602 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:29.128574 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5794566-b2b5h"] Jun 05 15:37:29.131794 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:29.131772 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c5794566-b2b5h"] Jun 05 15:37:30.117528 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:30.117496 2572 generic.go:356] "Generic (PLEG): container finished" podID="2331941e-c023-4afb-b017-e1a3a796c555" containerID="50e35cd5e8e61fbc5aa94ba59f05e5ac65c45ce7b7ef047c1e229b9989ec1fe1" exitCode=0 Jun 05 15:37:30.117984 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:30.117567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8sr6g" event={"ID":"2331941e-c023-4afb-b017-e1a3a796c555","Type":"ContainerDied","Data":"50e35cd5e8e61fbc5aa94ba59f05e5ac65c45ce7b7ef047c1e229b9989ec1fe1"} Jun 05 15:37:30.117984 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:30.117943 2572 scope.go:117] "RemoveContainer" containerID="50e35cd5e8e61fbc5aa94ba59f05e5ac65c45ce7b7ef047c1e229b9989ec1fe1" Jun 05 15:37:31.090716 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:31.090685 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e62e50bb-565f-44a1-ba88-5e7b0684172b" path="/var/lib/kubelet/pods/e62e50bb-565f-44a1-ba88-5e7b0684172b/volumes" Jun 05 15:37:31.124110 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:31.124080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8sr6g" event={"ID":"2331941e-c023-4afb-b017-e1a3a796c555","Type":"ContainerStarted","Data":"1c928bb2b35a4ed846562cf40d8b1ffb68b463c3ab7a338198d1d1d59f6782c0"} Jun 05 15:37:40.476306 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.476239 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" containerName="registry" containerID="cri-o://ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0" gracePeriod=30 Jun 05 15:37:40.711339 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.711315 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:37:40.880298 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880274 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-image-registry-private-configuration\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.880479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880350 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-ca-trust-extracted\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.880479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880370 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-certificates\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.880479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880470 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-trusted-ca\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.880678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880525 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-bound-sa-token\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.880678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880553 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svfls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-kube-api-access-svfls\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.880678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880603 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.880678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880660 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-installation-pull-secrets\") pod \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\" (UID: \"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0\") " Jun 05 15:37:40.881102 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.880995 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:37:40.881272 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.881166 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:37:40.883347 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.883317 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:37:40.883447 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.883371 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-kube-api-access-svfls" (OuterVolumeSpecName: "kube-api-access-svfls") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "kube-api-access-svfls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:37:40.883447 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.883428 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:37:40.883447 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.883433 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:37:40.883647 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.883603 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:37:40.889479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.889454 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" (UID: "b15e90e1-6655-4ac0-82f6-e0c2e973a3f0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:37:40.982038 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982012 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-bound-sa-token\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:40.982152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982041 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svfls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-kube-api-access-svfls\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:40.982152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982057 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-tls\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:40.982152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982071 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-installation-pull-secrets\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:40.982152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982087 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-image-registry-private-configuration\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:40.982152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982096 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-ca-trust-extracted\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:40.982152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982104 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-registry-certificates\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:40.982152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:40.982113 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0-trusted-ca\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:37:41.168472 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.168400 2572 generic.go:356] "Generic (PLEG): container finished" podID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" containerID="ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0" exitCode=0 Jun 05 15:37:41.168472 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.168445 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" Jun 05 15:37:41.168648 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.168481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" event={"ID":"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0","Type":"ContainerDied","Data":"ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0"} Jun 05 15:37:41.168648 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.168526 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f5d48d-9cr8f" event={"ID":"b15e90e1-6655-4ac0-82f6-e0c2e973a3f0","Type":"ContainerDied","Data":"9d01fa59803432cf99d2af397e4ad2a9847d3187035dbae28451dc9e1bd57acb"} Jun 05 15:37:41.168648 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.168547 2572 scope.go:117] "RemoveContainer" containerID="ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0" Jun 05 15:37:41.176927 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.176909 2572 scope.go:117] "RemoveContainer" containerID="ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0" Jun 05 15:37:41.177187 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:37:41.177166 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0\": container with ID starting with ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0 not found: ID does not exist" containerID="ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0" Jun 05 15:37:41.177251 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.177194 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0"} err="failed to get container status \"ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0\": rpc error: code = NotFound desc = could not find container \"ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0\": container with ID starting with ec09058ee5635754bddc032997244022f6e08edc67a557f457c81c78180a93e0 not found: ID does not exist" Jun 05 15:37:41.186152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.186127 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc7f5d48d-9cr8f"] Jun 05 15:37:41.189555 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:41.189533 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fc7f5d48d-9cr8f"] Jun 05 15:37:43.089502 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:43.089466 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" path="/var/lib/kubelet/pods/b15e90e1-6655-4ac0-82f6-e0c2e973a3f0/volumes" Jun 05 15:37:45.185074 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:45.185042 2572 generic.go:356] "Generic (PLEG): container finished" podID="d5728d9b-d895-49e0-87d6-8b1863c2447f" containerID="f04f9f020c568e7d686d19f420eb7d307e70525622f7802fa273bdc61a448412" exitCode=0 Jun 05 15:37:45.185427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:45.185117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" event={"ID":"d5728d9b-d895-49e0-87d6-8b1863c2447f","Type":"ContainerDied","Data":"f04f9f020c568e7d686d19f420eb7d307e70525622f7802fa273bdc61a448412"} Jun 05 15:37:45.185427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:45.185405 2572 scope.go:117] "RemoveContainer" containerID="f04f9f020c568e7d686d19f420eb7d307e70525622f7802fa273bdc61a448412" Jun 05 15:37:46.191020 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:37:46.190986 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mbm84" event={"ID":"d5728d9b-d895-49e0-87d6-8b1863c2447f","Type":"ContainerStarted","Data":"a4410b577e20f19fd6ffe68bbb918e1781d43651aa6ae7abcd411f423ba31e0c"} Jun 05 15:38:24.932402 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:24.932368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:38:24.934642 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:24.934597 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44c3fb43-2064-4313-bcec-49d65a2676da-metrics-certs\") pod \"network-metrics-daemon-8wl98\" (UID: \"44c3fb43-2064-4313-bcec-49d65a2676da\") " pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:38:25.187247 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:25.187221 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f757z\"" Jun 05 15:38:25.195711 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:25.195693 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wl98" Jun 05 15:38:25.322943 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:25.322921 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wl98"] Jun 05 15:38:25.325651 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:38:25.325593 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c3fb43_2064_4313_bcec_49d65a2676da.slice/crio-61ee97c367f101918fb26dd01a2803a7d9df3368f47ed02bc3a21c31289a09f0 WatchSource:0}: Error finding container 61ee97c367f101918fb26dd01a2803a7d9df3368f47ed02bc3a21c31289a09f0: Status 404 returned error can't find the container with id 61ee97c367f101918fb26dd01a2803a7d9df3368f47ed02bc3a21c31289a09f0 Jun 05 15:38:25.327475 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:25.327460 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:38:25.336206 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:25.336181 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wl98" event={"ID":"44c3fb43-2064-4313-bcec-49d65a2676da","Type":"ContainerStarted","Data":"61ee97c367f101918fb26dd01a2803a7d9df3368f47ed02bc3a21c31289a09f0"} Jun 05 15:38:27.345757 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:27.345722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wl98" event={"ID":"44c3fb43-2064-4313-bcec-49d65a2676da","Type":"ContainerStarted","Data":"765b629e3cc3e2bf6d2d776905d7b81a34b271ed52a6a465240dc413f3cf9581"} Jun 05 15:38:27.346146 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:27.345777 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wl98" event={"ID":"44c3fb43-2064-4313-bcec-49d65a2676da","Type":"ContainerStarted","Data":"f67c1dbed3454aae323a7ba327968b00ba005a0de3de136d251e9fe98c34d6a4"} Jun 05 15:38:27.361279 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:27.361237 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8wl98" podStartSLOduration=375.080771655 podStartE2EDuration="6m16.361220829s" totalImagesPullingTime="1.280449174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:38:27.360706068 +0000 UTC m=+376.769844640" watchObservedRunningTime="2026-06-05 15:38:27.361220829 +0000 UTC m=+376.770359399" Jun 05 15:38:41.052422 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.052387 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f78d75b9b-5q79v"] Jun 05 15:38:41.052873 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.052704 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e62e50bb-565f-44a1-ba88-5e7b0684172b" containerName="console" Jun 05 15:38:41.052873 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.052717 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e62e50bb-565f-44a1-ba88-5e7b0684172b" containerName="console" Jun 05 15:38:41.052873 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.052731 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" containerName="registry" Jun 05 15:38:41.052873 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.052736 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" containerName="registry" Jun 05 15:38:41.052873 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.052779 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15e90e1-6655-4ac0-82f6-e0c2e973a3f0" containerName="registry" Jun 05 15:38:41.052873 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.052789 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e62e50bb-565f-44a1-ba88-5e7b0684172b" containerName="console" Jun 05 15:38:41.060729 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.060701 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.069800 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.069775 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f78d75b9b-5q79v"] Jun 05 15:38:41.161094 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.161065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-service-ca\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.161248 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.161109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76pmk\" (UniqueName: \"kubernetes.io/projected/33138756-cd91-400c-b919-e2f54e318ce8-kube-api-access-76pmk\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.161248 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.161135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-trusted-ca-bundle\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.161248 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.161188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-console-config\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.161248 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.161225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-oauth-config\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.161417 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.161262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-serving-cert\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.161417 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.161311 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-oauth-serving-cert\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262078 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-service-ca\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262220 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76pmk\" (UniqueName: \"kubernetes.io/projected/33138756-cd91-400c-b919-e2f54e318ce8-kube-api-access-76pmk\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262220 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262107 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-trusted-ca-bundle\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262220 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-console-config\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262220 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-oauth-config\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262220 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-serving-cert\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262514 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-oauth-serving-cert\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.262912 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262871 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-service-ca\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.263035 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262926 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-oauth-serving-cert\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.263035 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.262984 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-console-config\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.263035 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.263020 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-trusted-ca-bundle\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.264721 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.264701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-serving-cert\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.264809 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.264775 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-oauth-config\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.269784 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.269760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76pmk\" (UniqueName: \"kubernetes.io/projected/33138756-cd91-400c-b919-e2f54e318ce8-kube-api-access-76pmk\") pod \"console-f78d75b9b-5q79v\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.371166 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.371145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:41.498427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:41.498403 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f78d75b9b-5q79v"] Jun 05 15:38:41.500555 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:38:41.500525 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33138756_cd91_400c_b919_e2f54e318ce8.slice/crio-f63a551e8ef942e8eb9960f313a0c656e33ce053e0d500b1498eac32f19cedf6 WatchSource:0}: Error finding container f63a551e8ef942e8eb9960f313a0c656e33ce053e0d500b1498eac32f19cedf6: Status 404 returned error can't find the container with id f63a551e8ef942e8eb9960f313a0c656e33ce053e0d500b1498eac32f19cedf6 Jun 05 15:38:42.403223 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:42.403169 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f78d75b9b-5q79v" event={"ID":"33138756-cd91-400c-b919-e2f54e318ce8","Type":"ContainerStarted","Data":"3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87"} Jun 05 15:38:42.403577 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:42.403236 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f78d75b9b-5q79v" event={"ID":"33138756-cd91-400c-b919-e2f54e318ce8","Type":"ContainerStarted","Data":"f63a551e8ef942e8eb9960f313a0c656e33ce053e0d500b1498eac32f19cedf6"} Jun 05 15:38:42.421839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:42.421795 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f78d75b9b-5q79v" podStartSLOduration=1.4217809670000001 podStartE2EDuration="1.421780967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:38:42.420485609 +0000 UTC m=+391.829624195" watchObservedRunningTime="2026-06-05 15:38:42.421780967 +0000 UTC m=+391.830919532" Jun 05 15:38:51.371885 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:51.371851 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:51.372268 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:51.371923 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:51.376724 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:51.376702 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:51.442557 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:51.442533 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:38:51.489662 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:38:51.489620 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97fbbc5d-n77wz"] Jun 05 15:39:16.512012 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.511967 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-97fbbc5d-n77wz" podUID="07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" containerName="console" containerID="cri-o://db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078" gracePeriod=15 Jun 05 15:39:16.753835 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.753811 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:39:16.812807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.812732 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-config\") pod \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " Jun 05 15:39:16.812807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.812766 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-trusted-ca-bundle\") pod \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " Jun 05 15:39:16.812807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.812797 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-oauth-config\") pod \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " Jun 05 15:39:16.813069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.812838 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-service-ca\") pod \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " Jun 05 15:39:16.813069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.812879 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-oauth-serving-cert\") pod \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " Jun 05 15:39:16.813069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.812907 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-serving-cert\") pod \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " Jun 05 15:39:16.813069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.812936 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr955\" (UniqueName: \"kubernetes.io/projected/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-kube-api-access-zr955\") pod \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\" (UID: \"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f\") " Jun 05 15:39:16.813259 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.813130 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-config" (OuterVolumeSpecName: "console-config") pod "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" (UID: "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:16.813259 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.813226 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" (UID: "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:16.813384 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.813362 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" (UID: "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:16.813443 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.813418 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" (UID: "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:16.814951 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.814920 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" (UID: "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:16.815160 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.815133 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" (UID: "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:16.815331 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.815309 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-kube-api-access-zr955" (OuterVolumeSpecName: "kube-api-access-zr955") pod "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" (UID: "07e30e27-12b4-4c36-b13d-dc56a6cc7a7f"). InnerVolumeSpecName "kube-api-access-zr955". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:39:16.913742 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.913711 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-oauth-serving-cert\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:16.913742 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.913734 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-serving-cert\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:16.913742 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.913744 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr955\" (UniqueName: \"kubernetes.io/projected/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-kube-api-access-zr955\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:16.913950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.913753 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-config\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:16.913950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.913761 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-trusted-ca-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:16.913950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.913769 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-console-oauth-config\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:16.913950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:16.913777 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f-service-ca\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:17.541470 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.541437 2572 generic.go:356] "Generic (PLEG): container finished" podID="07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" containerID="db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078" exitCode=0 Jun 05 15:39:17.541944 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.541481 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fbbc5d-n77wz" Jun 05 15:39:17.541944 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.541516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fbbc5d-n77wz" event={"ID":"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f","Type":"ContainerDied","Data":"db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078"} Jun 05 15:39:17.541944 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.541565 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fbbc5d-n77wz" event={"ID":"07e30e27-12b4-4c36-b13d-dc56a6cc7a7f","Type":"ContainerDied","Data":"f14d1f46082ba354c0170e11789434bbef287d5138422058ab07927dae67989c"} Jun 05 15:39:17.541944 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.541587 2572 scope.go:117] "RemoveContainer" containerID="db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078" Jun 05 15:39:17.549605 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.549590 2572 scope.go:117] "RemoveContainer" containerID="db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078" Jun 05 15:39:17.549895 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:39:17.549876 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078\": container with ID starting with db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078 not found: ID does not exist" containerID="db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078" Jun 05 15:39:17.549959 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.549901 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078"} err="failed to get container status \"db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078\": rpc error: code = NotFound desc = could not find container \"db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078\": container with ID starting with db12a270b09648245ff9a447cc861846ba9156dc49b9e625d7f2543944100078 not found: ID does not exist" Jun 05 15:39:17.558116 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.558097 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97fbbc5d-n77wz"] Jun 05 15:39:17.561454 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:17.561431 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97fbbc5d-n77wz"] Jun 05 15:39:19.088450 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:19.088419 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" path="/var/lib/kubelet/pods/07e30e27-12b4-4c36-b13d-dc56a6cc7a7f/volumes" Jun 05 15:39:25.499912 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.499877 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p"] Jun 05 15:39:25.500276 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.500193 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" containerName="console" Jun 05 15:39:25.500276 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.500203 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" containerName="console" Jun 05 15:39:25.500276 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.500252 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e30e27-12b4-4c36-b13d-dc56a6cc7a7f" containerName="console" Jun 05 15:39:25.503185 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.503164 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.506111 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.506083 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:39:25.506213 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.506119 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:39:25.507064 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.507041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pvz2p\"" Jun 05 15:39:25.511416 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.511395 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p"] Jun 05 15:39:25.574007 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.573968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vw5\" (UniqueName: \"kubernetes.io/projected/528a97e1-81b4-4b4f-8188-e7ec480994b7-kube-api-access-l4vw5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.574007 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.574031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.574240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.574149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.674830 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.674799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.674957 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.674839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vw5\" (UniqueName: \"kubernetes.io/projected/528a97e1-81b4-4b4f-8188-e7ec480994b7-kube-api-access-l4vw5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.674957 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.674864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.675172 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.675152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.675259 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.675244 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.683455 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.683433 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vw5\" (UniqueName: \"kubernetes.io/projected/528a97e1-81b4-4b4f-8188-e7ec480994b7-kube-api-access-l4vw5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.812811 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.812750 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:25.941701 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:25.941507 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p"] Jun 05 15:39:25.944539 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:39:25.944509 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528a97e1_81b4_4b4f_8188_e7ec480994b7.slice/crio-f44d6f6cc9e0a1928c4942a9e11f4a40a30d38c0b4b705e52bd6218d8f68006e WatchSource:0}: Error finding container f44d6f6cc9e0a1928c4942a9e11f4a40a30d38c0b4b705e52bd6218d8f68006e: Status 404 returned error can't find the container with id f44d6f6cc9e0a1928c4942a9e11f4a40a30d38c0b4b705e52bd6218d8f68006e Jun 05 15:39:26.576531 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:26.576498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" event={"ID":"528a97e1-81b4-4b4f-8188-e7ec480994b7","Type":"ContainerStarted","Data":"f44d6f6cc9e0a1928c4942a9e11f4a40a30d38c0b4b705e52bd6218d8f68006e"} Jun 05 15:39:33.606746 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:33.606710 2572 generic.go:356] "Generic (PLEG): container finished" podID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerID="f92cdbbb84cd9465ed39b5dc217e58f22cae8949833394a2cd3ef1c8b0d4e1ff" exitCode=0 Jun 05 15:39:33.607070 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:33.606799 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" event={"ID":"528a97e1-81b4-4b4f-8188-e7ec480994b7","Type":"ContainerDied","Data":"f92cdbbb84cd9465ed39b5dc217e58f22cae8949833394a2cd3ef1c8b0d4e1ff"} Jun 05 15:39:36.620663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:36.620605 2572 generic.go:356] "Generic (PLEG): container finished" podID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerID="bbbe163a55ee6ca842f5bd04ea2965c701efdd75dc9917f3b66ecb00f293996e" exitCode=0 Jun 05 15:39:36.621020 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:36.620667 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" event={"ID":"528a97e1-81b4-4b4f-8188-e7ec480994b7","Type":"ContainerDied","Data":"bbbe163a55ee6ca842f5bd04ea2965c701efdd75dc9917f3b66ecb00f293996e"} Jun 05 15:39:44.660328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:44.660295 2572 generic.go:356] "Generic (PLEG): container finished" podID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerID="612d74e50894df9bfa7f7576749f8fddd1f1f50cdbef3296ff8140824dcb5bc5" exitCode=0 Jun 05 15:39:44.660742 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:44.660381 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" event={"ID":"528a97e1-81b4-4b4f-8188-e7ec480994b7","Type":"ContainerDied","Data":"612d74e50894df9bfa7f7576749f8fddd1f1f50cdbef3296ff8140824dcb5bc5"} Jun 05 15:39:45.786238 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.786211 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:45.840181 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.840154 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-bundle\") pod \"528a97e1-81b4-4b4f-8188-e7ec480994b7\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " Jun 05 15:39:45.840286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.840186 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4vw5\" (UniqueName: \"kubernetes.io/projected/528a97e1-81b4-4b4f-8188-e7ec480994b7-kube-api-access-l4vw5\") pod \"528a97e1-81b4-4b4f-8188-e7ec480994b7\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " Jun 05 15:39:45.840286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.840267 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-util\") pod \"528a97e1-81b4-4b4f-8188-e7ec480994b7\" (UID: \"528a97e1-81b4-4b4f-8188-e7ec480994b7\") " Jun 05 15:39:45.840854 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.840822 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-bundle" (OuterVolumeSpecName: "bundle") pod "528a97e1-81b4-4b4f-8188-e7ec480994b7" (UID: "528a97e1-81b4-4b4f-8188-e7ec480994b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:39:45.842259 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.842235 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528a97e1-81b4-4b4f-8188-e7ec480994b7-kube-api-access-l4vw5" (OuterVolumeSpecName: "kube-api-access-l4vw5") pod "528a97e1-81b4-4b4f-8188-e7ec480994b7" (UID: "528a97e1-81b4-4b4f-8188-e7ec480994b7"). InnerVolumeSpecName "kube-api-access-l4vw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:39:45.844458 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.844434 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-util" (OuterVolumeSpecName: "util") pod "528a97e1-81b4-4b4f-8188-e7ec480994b7" (UID: "528a97e1-81b4-4b4f-8188-e7ec480994b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:39:45.941084 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.941010 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:45.941084 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.941039 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528a97e1-81b4-4b4f-8188-e7ec480994b7-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:45.941084 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:45.941054 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4vw5\" (UniqueName: \"kubernetes.io/projected/528a97e1-81b4-4b4f-8188-e7ec480994b7-kube-api-access-l4vw5\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:39:46.670517 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:46.670484 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" event={"ID":"528a97e1-81b4-4b4f-8188-e7ec480994b7","Type":"ContainerDied","Data":"f44d6f6cc9e0a1928c4942a9e11f4a40a30d38c0b4b705e52bd6218d8f68006e"} Jun 05 15:39:46.670724 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:46.670532 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f44d6f6cc9e0a1928c4942a9e11f4a40a30d38c0b4b705e52bd6218d8f68006e" Jun 05 15:39:46.670724 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:46.670532 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqsf7p" Jun 05 15:39:53.621086 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621052 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc"] Jun 05 15:39:53.621515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621332 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerName="pull" Jun 05 15:39:53.621515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621344 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerName="pull" Jun 05 15:39:53.621515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621360 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerName="extract" Jun 05 15:39:53.621515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621365 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerName="extract" Jun 05 15:39:53.621515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621377 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerName="util" Jun 05 15:39:53.621515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621383 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerName="util" Jun 05 15:39:53.621515 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.621432 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="528a97e1-81b4-4b4f-8188-e7ec480994b7" containerName="extract" Jun 05 15:39:53.627005 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.626986 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:53.629587 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.629566 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:39:53.629704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.629643 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 15:39:53.629704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.629644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xdk6n\"" Jun 05 15:39:53.637072 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.637050 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc"] Jun 05 15:39:53.702408 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.702382 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t6tkc\" (UID: \"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:53.702518 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.702466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spp4q\" (UniqueName: \"kubernetes.io/projected/f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2-kube-api-access-spp4q\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t6tkc\" (UID: \"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:53.803071 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.803040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp4q\" (UniqueName: \"kubernetes.io/projected/f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2-kube-api-access-spp4q\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t6tkc\" (UID: \"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:53.803239 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.803085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t6tkc\" (UID: \"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:53.803414 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.803396 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t6tkc\" (UID: \"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:53.811647 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.811605 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spp4q\" (UniqueName: \"kubernetes.io/projected/f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2-kube-api-access-spp4q\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t6tkc\" (UID: \"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:53.937371 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:53.937290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" Jun 05 15:39:54.064796 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:54.064770 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc"] Jun 05 15:39:54.067403 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:39:54.067379 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f5caa1_5e92_4a50_ba15_1ce5a6dbeec2.slice/crio-d9f0cd025a900e8e293ea681818804819b56db210185c8c2a9329ac6fd9260fe WatchSource:0}: Error finding container d9f0cd025a900e8e293ea681818804819b56db210185c8c2a9329ac6fd9260fe: Status 404 returned error can't find the container with id d9f0cd025a900e8e293ea681818804819b56db210185c8c2a9329ac6fd9260fe Jun 05 15:39:54.702843 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:54.702800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" event={"ID":"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2","Type":"ContainerStarted","Data":"d9f0cd025a900e8e293ea681818804819b56db210185c8c2a9329ac6fd9260fe"} Jun 05 15:39:56.713943 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:56.713907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" event={"ID":"f6f5caa1-5e92-4a50-ba15-1ce5a6dbeec2","Type":"ContainerStarted","Data":"0fb8ba7d28ecc10226c26cebcc7ec7225782691731c2af7d89e481f770d3df37"} Jun 05 15:39:56.741252 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:56.741198 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t6tkc" podStartSLOduration=1.880450562 podStartE2EDuration="3.741181497s" totalImagesPullingTime="1.860730935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:39:56.738192952 +0000 UTC m=+466.147331530" watchObservedRunningTime="2026-06-05 15:39:56.741181497 +0000 UTC m=+466.150320064" Jun 05 15:39:57.742335 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.742304 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2"] Jun 05 15:39:57.745761 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.745745 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.748733 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.748713 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pvz2p\"" Jun 05 15:39:57.748733 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.748723 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:39:57.749771 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.749758 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:39:57.757800 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.757775 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2"] Jun 05 15:39:57.836839 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.836809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.836978 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.836910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv8b4\" (UniqueName: \"kubernetes.io/projected/7364d71f-9d60-4ec2-a257-08183eb271e8-kube-api-access-dv8b4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.836978 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.836965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.938182 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.938154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.938324 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.938196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.938324 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.938246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv8b4\" (UniqueName: \"kubernetes.io/projected/7364d71f-9d60-4ec2-a257-08183eb271e8-kube-api-access-dv8b4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.938546 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.938526 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.938617 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.938575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:57.954727 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:57.954702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv8b4\" (UniqueName: \"kubernetes.io/projected/7364d71f-9d60-4ec2-a257-08183eb271e8-kube-api-access-dv8b4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:58.055042 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:58.054964 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:39:58.184447 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:58.184387 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2"] Jun 05 15:39:58.186543 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:39:58.186519 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7364d71f_9d60_4ec2_a257_08183eb271e8.slice/crio-2acc6944548d6b6a65cff796652bab5e76953508d2face3864de04e5072d0a43 WatchSource:0}: Error finding container 2acc6944548d6b6a65cff796652bab5e76953508d2face3864de04e5072d0a43: Status 404 returned error can't find the container with id 2acc6944548d6b6a65cff796652bab5e76953508d2face3864de04e5072d0a43 Jun 05 15:39:58.723374 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:58.723335 2572 generic.go:356] "Generic (PLEG): container finished" podID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerID="23603a7a086b5435fd2904b3690d07ae5fec8e5ee67974d51c32a742c4c2f79b" exitCode=0 Jun 05 15:39:58.723535 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:58.723413 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" event={"ID":"7364d71f-9d60-4ec2-a257-08183eb271e8","Type":"ContainerDied","Data":"23603a7a086b5435fd2904b3690d07ae5fec8e5ee67974d51c32a742c4c2f79b"} Jun 05 15:39:58.723535 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:58.723460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" event={"ID":"7364d71f-9d60-4ec2-a257-08183eb271e8","Type":"ContainerStarted","Data":"2acc6944548d6b6a65cff796652bab5e76953508d2face3864de04e5072d0a43"} Jun 05 15:39:59.361048 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.361013 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-z2shm"] Jun 05 15:39:59.364105 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.364090 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.366687 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.366669 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 15:39:59.367762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.367746 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-md8r8\"" Jun 05 15:39:59.367824 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.367767 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 15:39:59.375748 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.375728 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-z2shm"] Jun 05 15:39:59.451998 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.451974 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3db4e4c3-5f59-41b1-a637-0948edb6b931-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-z2shm\" (UID: \"3db4e4c3-5f59-41b1-a637-0948edb6b931\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.452128 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.452009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxcw\" (UniqueName: \"kubernetes.io/projected/3db4e4c3-5f59-41b1-a637-0948edb6b931-kube-api-access-2qxcw\") pod \"cert-manager-webhook-7dc76cbb94-z2shm\" (UID: \"3db4e4c3-5f59-41b1-a637-0948edb6b931\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.553466 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.553437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3db4e4c3-5f59-41b1-a637-0948edb6b931-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-z2shm\" (UID: \"3db4e4c3-5f59-41b1-a637-0948edb6b931\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.553577 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.553472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxcw\" (UniqueName: \"kubernetes.io/projected/3db4e4c3-5f59-41b1-a637-0948edb6b931-kube-api-access-2qxcw\") pod \"cert-manager-webhook-7dc76cbb94-z2shm\" (UID: \"3db4e4c3-5f59-41b1-a637-0948edb6b931\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.561964 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.561927 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3db4e4c3-5f59-41b1-a637-0948edb6b931-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-z2shm\" (UID: \"3db4e4c3-5f59-41b1-a637-0948edb6b931\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.562137 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.562117 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxcw\" (UniqueName: \"kubernetes.io/projected/3db4e4c3-5f59-41b1-a637-0948edb6b931-kube-api-access-2qxcw\") pod \"cert-manager-webhook-7dc76cbb94-z2shm\" (UID: \"3db4e4c3-5f59-41b1-a637-0948edb6b931\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.683820 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.683785 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:39:59.830836 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:39:59.830805 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-z2shm"] Jun 05 15:39:59.832687 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:39:59.832663 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3db4e4c3_5f59_41b1_a637_0948edb6b931.slice/crio-01d157dde1a4033f142973a7631c025633f2e11dd00c9bf47dd3329c33b75c68 WatchSource:0}: Error finding container 01d157dde1a4033f142973a7631c025633f2e11dd00c9bf47dd3329c33b75c68: Status 404 returned error can't find the container with id 01d157dde1a4033f142973a7631c025633f2e11dd00c9bf47dd3329c33b75c68 Jun 05 15:40:00.735423 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:00.735386 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" event={"ID":"3db4e4c3-5f59-41b1-a637-0948edb6b931","Type":"ContainerStarted","Data":"01d157dde1a4033f142973a7631c025633f2e11dd00c9bf47dd3329c33b75c68"} Jun 05 15:40:01.742554 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:01.742520 2572 generic.go:356] "Generic (PLEG): container finished" podID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerID="ffcd0ff66c6f252967ca4b3dd190197ba5c60cf58d93e60976d57bfc958c4ea8" exitCode=0 Jun 05 15:40:01.743003 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:01.742605 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" event={"ID":"7364d71f-9d60-4ec2-a257-08183eb271e8","Type":"ContainerDied","Data":"ffcd0ff66c6f252967ca4b3dd190197ba5c60cf58d93e60976d57bfc958c4ea8"} Jun 05 15:40:02.749990 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:02.749948 2572 generic.go:356] "Generic (PLEG): container finished" podID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerID="030158e5297328d04643975438de43218259ace5195d73ce752720aefc114abe" exitCode=0 Jun 05 15:40:02.750434 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:02.750003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" event={"ID":"7364d71f-9d60-4ec2-a257-08183eb271e8","Type":"ContainerDied","Data":"030158e5297328d04643975438de43218259ace5195d73ce752720aefc114abe"} Jun 05 15:40:03.756694 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.756658 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" event={"ID":"3db4e4c3-5f59-41b1-a637-0948edb6b931","Type":"ContainerStarted","Data":"e270f31f6b7c86ac2aa505c54500a47ba871f0ded3dd091b60ddd8ad1f006d30"} Jun 05 15:40:03.757093 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.756977 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:40:03.774357 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.774300 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" podStartSLOduration=1.5793580569999999 podStartE2EDuration="4.774280535s" totalImagesPullingTime="3.194922478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:40:03.773864617 +0000 UTC m=+473.183003218" watchObservedRunningTime="2026-06-05 15:40:03.774280535 +0000 UTC m=+473.183419103" Jun 05 15:40:03.886969 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.886946 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:40:03.995927 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.995897 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-util\") pod \"7364d71f-9d60-4ec2-a257-08183eb271e8\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " Jun 05 15:40:03.996099 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.995944 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv8b4\" (UniqueName: \"kubernetes.io/projected/7364d71f-9d60-4ec2-a257-08183eb271e8-kube-api-access-dv8b4\") pod \"7364d71f-9d60-4ec2-a257-08183eb271e8\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " Jun 05 15:40:03.996099 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.995995 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-bundle\") pod \"7364d71f-9d60-4ec2-a257-08183eb271e8\" (UID: \"7364d71f-9d60-4ec2-a257-08183eb271e8\") " Jun 05 15:40:03.996424 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.996398 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-bundle" (OuterVolumeSpecName: "bundle") pod "7364d71f-9d60-4ec2-a257-08183eb271e8" (UID: "7364d71f-9d60-4ec2-a257-08183eb271e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:40:03.998062 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:03.998030 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7364d71f-9d60-4ec2-a257-08183eb271e8-kube-api-access-dv8b4" (OuterVolumeSpecName: "kube-api-access-dv8b4") pod "7364d71f-9d60-4ec2-a257-08183eb271e8" (UID: "7364d71f-9d60-4ec2-a257-08183eb271e8"). InnerVolumeSpecName "kube-api-access-dv8b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:40:04.000811 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.000788 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-util" (OuterVolumeSpecName: "util") pod "7364d71f-9d60-4ec2-a257-08183eb271e8" (UID: "7364d71f-9d60-4ec2-a257-08183eb271e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:40:04.096847 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.096759 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:40:04.096847 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.096790 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv8b4\" (UniqueName: \"kubernetes.io/projected/7364d71f-9d60-4ec2-a257-08183eb271e8-kube-api-access-dv8b4\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:40:04.096847 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.096800 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7364d71f-9d60-4ec2-a257-08183eb271e8-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.763313 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg"] Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.764035 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerName="extract" Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.764055 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerName="extract" Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.764066 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerName="util" Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.764074 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerName="util" Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.764109 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerName="pull" Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.764117 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerName="pull" Jun 05 15:40:04.765764 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.764250 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7364d71f-9d60-4ec2-a257-08183eb271e8" containerName="extract" Jun 05 15:40:04.769227 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.769205 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" Jun 05 15:40:04.769570 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.769543 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5nb2" event={"ID":"7364d71f-9d60-4ec2-a257-08183eb271e8","Type":"ContainerDied","Data":"2acc6944548d6b6a65cff796652bab5e76953508d2face3864de04e5072d0a43"} Jun 05 15:40:04.769692 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.769579 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2acc6944548d6b6a65cff796652bab5e76953508d2face3864de04e5072d0a43" Jun 05 15:40:04.769692 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.769667 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:04.772482 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.772460 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q2lv8\"" Jun 05 15:40:04.775622 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.775600 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg"] Jun 05 15:40:04.904104 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.904071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b4c05db-1985-4148-a720-9a32a47fb379-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-sjrvg\" (UID: \"8b4c05db-1985-4148-a720-9a32a47fb379\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:04.904292 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:04.904126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5rl\" (UniqueName: \"kubernetes.io/projected/8b4c05db-1985-4148-a720-9a32a47fb379-kube-api-access-nd5rl\") pod \"cert-manager-cainjector-5d99449ffd-sjrvg\" (UID: \"8b4c05db-1985-4148-a720-9a32a47fb379\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:05.005517 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.005476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b4c05db-1985-4148-a720-9a32a47fb379-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-sjrvg\" (UID: \"8b4c05db-1985-4148-a720-9a32a47fb379\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:05.005704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.005573 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5rl\" (UniqueName: \"kubernetes.io/projected/8b4c05db-1985-4148-a720-9a32a47fb379-kube-api-access-nd5rl\") pod \"cert-manager-cainjector-5d99449ffd-sjrvg\" (UID: \"8b4c05db-1985-4148-a720-9a32a47fb379\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:05.014418 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.014393 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5rl\" (UniqueName: \"kubernetes.io/projected/8b4c05db-1985-4148-a720-9a32a47fb379-kube-api-access-nd5rl\") pod \"cert-manager-cainjector-5d99449ffd-sjrvg\" (UID: \"8b4c05db-1985-4148-a720-9a32a47fb379\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:05.014538 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.014398 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b4c05db-1985-4148-a720-9a32a47fb379-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-sjrvg\" (UID: \"8b4c05db-1985-4148-a720-9a32a47fb379\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:05.081413 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.081326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" Jun 05 15:40:05.217829 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.217792 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg"] Jun 05 15:40:05.220519 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:40:05.220492 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b4c05db_1985_4148_a720_9a32a47fb379.slice/crio-b282a27a9d435595e68cdf83051de0c3764dac3531e6fb85a8880358b6eb708e WatchSource:0}: Error finding container b282a27a9d435595e68cdf83051de0c3764dac3531e6fb85a8880358b6eb708e: Status 404 returned error can't find the container with id b282a27a9d435595e68cdf83051de0c3764dac3531e6fb85a8880358b6eb708e Jun 05 15:40:05.775358 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.775321 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" event={"ID":"8b4c05db-1985-4148-a720-9a32a47fb379","Type":"ContainerStarted","Data":"57c84175de7e0a56f15e0a1f24f425e0f4628c374de0863934b6a0b720701976"} Jun 05 15:40:05.775358 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.775365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" event={"ID":"8b4c05db-1985-4148-a720-9a32a47fb379","Type":"ContainerStarted","Data":"b282a27a9d435595e68cdf83051de0c3764dac3531e6fb85a8880358b6eb708e"} Jun 05 15:40:05.793105 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:05.793057 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sjrvg" podStartSLOduration=1.793041663 podStartE2EDuration="1.793041663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:40:05.791779139 +0000 UTC m=+475.200917708" watchObservedRunningTime="2026-06-05 15:40:05.793041663 +0000 UTC m=+475.202180230" Jun 05 15:40:09.771439 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:09.771408 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-z2shm" Jun 05 15:40:11.439476 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.439440 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr"] Jun 05 15:40:11.444401 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.444379 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.447331 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.447311 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 15:40:11.448320 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.448304 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:40:11.448394 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.448316 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ztc2z\"" Jun 05 15:40:11.451973 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.451948 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr"] Jun 05 15:40:11.558589 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.558551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62142234-143b-493e-9b0d-f9970f212a0a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxqnr\" (UID: \"62142234-143b-493e-9b0d-f9970f212a0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.558753 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.558600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wmj8\" (UniqueName: \"kubernetes.io/projected/62142234-143b-493e-9b0d-f9970f212a0a-kube-api-access-9wmj8\") pod \"openshift-lws-operator-fd8ccff4c-sxqnr\" (UID: \"62142234-143b-493e-9b0d-f9970f212a0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.659040 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.659003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62142234-143b-493e-9b0d-f9970f212a0a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxqnr\" (UID: \"62142234-143b-493e-9b0d-f9970f212a0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.659176 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.659048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmj8\" (UniqueName: \"kubernetes.io/projected/62142234-143b-493e-9b0d-f9970f212a0a-kube-api-access-9wmj8\") pod \"openshift-lws-operator-fd8ccff4c-sxqnr\" (UID: \"62142234-143b-493e-9b0d-f9970f212a0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.659403 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.659381 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62142234-143b-493e-9b0d-f9970f212a0a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxqnr\" (UID: \"62142234-143b-493e-9b0d-f9970f212a0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.668219 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.668188 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wmj8\" (UniqueName: \"kubernetes.io/projected/62142234-143b-493e-9b0d-f9970f212a0a-kube-api-access-9wmj8\") pod \"openshift-lws-operator-fd8ccff4c-sxqnr\" (UID: \"62142234-143b-493e-9b0d-f9970f212a0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.753506 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.753416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" Jun 05 15:40:11.883440 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:11.883416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr"] Jun 05 15:40:11.885807 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:40:11.885778 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62142234_143b_493e_9b0d_f9970f212a0a.slice/crio-4dfaf75232d84a6dc9f9b31f641e4b4563a6fc8fc8fa32a62bd3323f6d59c6db WatchSource:0}: Error finding container 4dfaf75232d84a6dc9f9b31f641e4b4563a6fc8fc8fa32a62bd3323f6d59c6db: Status 404 returned error can't find the container with id 4dfaf75232d84a6dc9f9b31f641e4b4563a6fc8fc8fa32a62bd3323f6d59c6db Jun 05 15:40:12.812595 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:12.812552 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" event={"ID":"62142234-143b-493e-9b0d-f9970f212a0a","Type":"ContainerStarted","Data":"4dfaf75232d84a6dc9f9b31f641e4b4563a6fc8fc8fa32a62bd3323f6d59c6db"} Jun 05 15:40:14.826252 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:14.826210 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" event={"ID":"62142234-143b-493e-9b0d-f9970f212a0a","Type":"ContainerStarted","Data":"ae62531f8fdf14ec95b951ec6a1b439c2c4a92d9700005da08612e5a7e010a4e"} Jun 05 15:40:14.843923 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:14.843864 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxqnr" podStartSLOduration=1.778618053 podStartE2EDuration="3.843849593s" totalImagesPullingTime="2.06523154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:40:14.843314688 +0000 UTC m=+484.252453267" watchObservedRunningTime="2026-06-05 15:40:14.843849593 +0000 UTC m=+484.252988173" Jun 05 15:40:17.217810 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.217771 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt"] Jun 05 15:40:17.221349 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.221333 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.223974 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.223957 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pvz2p\"" Jun 05 15:40:17.224052 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.223999 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:40:17.224881 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.224862 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:40:17.230139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.230121 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt"] Jun 05 15:40:17.305464 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.305424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.305464 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.305459 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2fws\" (UniqueName: \"kubernetes.io/projected/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-kube-api-access-w2fws\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.305715 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.305480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.406086 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.406046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.406086 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.406088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2fws\" (UniqueName: \"kubernetes.io/projected/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-kube-api-access-w2fws\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.406290 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.406112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.406451 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.406426 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.406503 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.406485 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.414946 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.414913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2fws\" (UniqueName: \"kubernetes.io/projected/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-kube-api-access-w2fws\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.531317 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.531237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:17.659990 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.659963 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt"] Jun 05 15:40:17.661642 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:40:17.661602 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb492b1a5_242f_4c3d_9b78_37f2d9d28f87.slice/crio-017042ae9a21d1f6ecfd86c73fa62fe001a5b69e31933d71597c53e9f4c88031 WatchSource:0}: Error finding container 017042ae9a21d1f6ecfd86c73fa62fe001a5b69e31933d71597c53e9f4c88031: Status 404 returned error can't find the container with id 017042ae9a21d1f6ecfd86c73fa62fe001a5b69e31933d71597c53e9f4c88031 Jun 05 15:40:17.841426 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.841339 2572 generic.go:356] "Generic (PLEG): container finished" podID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerID="d024238dcfe5fd416cfa1a3488df29c97ffc43e6663d5f86ac70abba447ec320" exitCode=0 Jun 05 15:40:17.841426 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.841410 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" event={"ID":"b492b1a5-242f-4c3d-9b78-37f2d9d28f87","Type":"ContainerDied","Data":"d024238dcfe5fd416cfa1a3488df29c97ffc43e6663d5f86ac70abba447ec320"} Jun 05 15:40:17.841609 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:17.841449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" event={"ID":"b492b1a5-242f-4c3d-9b78-37f2d9d28f87","Type":"ContainerStarted","Data":"017042ae9a21d1f6ecfd86c73fa62fe001a5b69e31933d71597c53e9f4c88031"} Jun 05 15:40:18.847823 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:18.847730 2572 generic.go:356] "Generic (PLEG): container finished" podID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerID="76c719c0881ca9d121ba514ecf838b4574f00ddc4e8c87102c2499c0f3cfaa8d" exitCode=0 Jun 05 15:40:18.848224 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:18.847817 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" event={"ID":"b492b1a5-242f-4c3d-9b78-37f2d9d28f87","Type":"ContainerDied","Data":"76c719c0881ca9d121ba514ecf838b4574f00ddc4e8c87102c2499c0f3cfaa8d"} Jun 05 15:40:19.855101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:19.855060 2572 generic.go:356] "Generic (PLEG): container finished" podID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerID="1b5d740fdb7cf2b76bf24194fae02931779d5d4801bd186af2a88ccc2ba824a0" exitCode=0 Jun 05 15:40:19.855483 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:19.855138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" event={"ID":"b492b1a5-242f-4c3d-9b78-37f2d9d28f87","Type":"ContainerDied","Data":"1b5d740fdb7cf2b76bf24194fae02931779d5d4801bd186af2a88ccc2ba824a0"} Jun 05 15:40:20.993023 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:20.992998 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:21.037112 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.037085 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-bundle\") pod \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " Jun 05 15:40:21.037277 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.037124 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-util\") pod \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " Jun 05 15:40:21.037277 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.037151 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2fws\" (UniqueName: \"kubernetes.io/projected/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-kube-api-access-w2fws\") pod \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\" (UID: \"b492b1a5-242f-4c3d-9b78-37f2d9d28f87\") " Jun 05 15:40:21.038013 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.037985 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-bundle" (OuterVolumeSpecName: "bundle") pod "b492b1a5-242f-4c3d-9b78-37f2d9d28f87" (UID: "b492b1a5-242f-4c3d-9b78-37f2d9d28f87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:40:21.039192 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.039169 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-kube-api-access-w2fws" (OuterVolumeSpecName: "kube-api-access-w2fws") pod "b492b1a5-242f-4c3d-9b78-37f2d9d28f87" (UID: "b492b1a5-242f-4c3d-9b78-37f2d9d28f87"). InnerVolumeSpecName "kube-api-access-w2fws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:40:21.042612 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.042578 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-util" (OuterVolumeSpecName: "util") pod "b492b1a5-242f-4c3d-9b78-37f2d9d28f87" (UID: "b492b1a5-242f-4c3d-9b78-37f2d9d28f87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:40:21.137918 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.137886 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:40:21.137918 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.137915 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:40:21.137918 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.137924 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2fws\" (UniqueName: \"kubernetes.io/projected/b492b1a5-242f-4c3d-9b78-37f2d9d28f87-kube-api-access-w2fws\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:40:21.866281 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.866255 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" Jun 05 15:40:21.866460 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.866248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcdjqt" event={"ID":"b492b1a5-242f-4c3d-9b78-37f2d9d28f87","Type":"ContainerDied","Data":"017042ae9a21d1f6ecfd86c73fa62fe001a5b69e31933d71597c53e9f4c88031"} Jun 05 15:40:21.866460 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:21.866387 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="017042ae9a21d1f6ecfd86c73fa62fe001a5b69e31933d71597c53e9f4c88031" Jun 05 15:40:30.394551 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394515 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8"] Jun 05 15:40:30.395025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394828 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerName="util" Jun 05 15:40:30.395025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394838 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerName="util" Jun 05 15:40:30.395025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394853 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerName="pull" Jun 05 15:40:30.395025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394859 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerName="pull" Jun 05 15:40:30.395025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394874 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerName="extract" Jun 05 15:40:30.395025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394879 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerName="extract" Jun 05 15:40:30.395025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.394927 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b492b1a5-242f-4c3d-9b78-37f2d9d28f87" containerName="extract" Jun 05 15:40:30.398123 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.398106 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.401641 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.401609 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 15:40:30.402736 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.402718 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 15:40:30.402968 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.402952 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 15:40:30.403025 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.402952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xk2n5\"" Jun 05 15:40:30.404115 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.404100 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 15:40:30.471792 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.471763 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8"] Jun 05 15:40:30.521305 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.521273 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345ae7be-a715-4aa6-b260-1474fc08f114-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.521456 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.521309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ae7be-a715-4aa6-b260-1474fc08f114-tmp\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.521456 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.521346 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs55l\" (UniqueName: \"kubernetes.io/projected/345ae7be-a715-4aa6-b260-1474fc08f114-kube-api-access-bs55l\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.521456 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.521430 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/345ae7be-a715-4aa6-b260-1474fc08f114-manifests\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.521598 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.521466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/345ae7be-a715-4aa6-b260-1474fc08f114-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.622639 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.622605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/345ae7be-a715-4aa6-b260-1474fc08f114-manifests\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.622801 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.622671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/345ae7be-a715-4aa6-b260-1474fc08f114-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.622801 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.622728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345ae7be-a715-4aa6-b260-1474fc08f114-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.622801 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.622754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ae7be-a715-4aa6-b260-1474fc08f114-tmp\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.622801 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.622791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs55l\" (UniqueName: \"kubernetes.io/projected/345ae7be-a715-4aa6-b260-1474fc08f114-kube-api-access-bs55l\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.623024 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.623001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/345ae7be-a715-4aa6-b260-1474fc08f114-manifests\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.625074 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.625054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ae7be-a715-4aa6-b260-1474fc08f114-tmp\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.625210 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.625195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/345ae7be-a715-4aa6-b260-1474fc08f114-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.625367 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.625346 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345ae7be-a715-4aa6-b260-1474fc08f114-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.630097 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.630072 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs55l\" (UniqueName: \"kubernetes.io/projected/345ae7be-a715-4aa6-b260-1474fc08f114-kube-api-access-bs55l\") pod \"opendatahub-operator-controller-manager-56f4b89576-9txl8\" (UID: \"345ae7be-a715-4aa6-b260-1474fc08f114\") " pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.708505 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.708430 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:30.844805 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.844785 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8"] Jun 05 15:40:30.846643 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:40:30.846599 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345ae7be_a715_4aa6_b260_1474fc08f114.slice/crio-a222f7df8425d28303f0d21970f5e3b26abb78f4beff7e29f38c220dec774b7f WatchSource:0}: Error finding container a222f7df8425d28303f0d21970f5e3b26abb78f4beff7e29f38c220dec774b7f: Status 404 returned error can't find the container with id a222f7df8425d28303f0d21970f5e3b26abb78f4beff7e29f38c220dec774b7f Jun 05 15:40:30.914576 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:30.914535 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" event={"ID":"345ae7be-a715-4aa6-b260-1474fc08f114","Type":"ContainerStarted","Data":"a222f7df8425d28303f0d21970f5e3b26abb78f4beff7e29f38c220dec774b7f"} Jun 05 15:40:33.933224 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:33.933188 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" event={"ID":"345ae7be-a715-4aa6-b260-1474fc08f114","Type":"ContainerStarted","Data":"ed0cb1777f6d63ec7211b77dad4aef7f5443b3bb771ea546b79deffb24e2f107"} Jun 05 15:40:34.939563 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:34.939532 2572 generic.go:356] "Generic (PLEG): container finished" podID="345ae7be-a715-4aa6-b260-1474fc08f114" containerID="ed0cb1777f6d63ec7211b77dad4aef7f5443b3bb771ea546b79deffb24e2f107" exitCode=0 Jun 05 15:40:34.939933 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:34.939600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" event={"ID":"345ae7be-a715-4aa6-b260-1474fc08f114","Type":"ContainerDied","Data":"ed0cb1777f6d63ec7211b77dad4aef7f5443b3bb771ea546b79deffb24e2f107"} Jun 05 15:40:35.947773 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:35.947736 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" event={"ID":"345ae7be-a715-4aa6-b260-1474fc08f114","Type":"ContainerStarted","Data":"d7f49b22dc7416f0dcb0e095465af657485b70261e9c8604ba4875b1c72b4517"} Jun 05 15:40:35.948243 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:35.947867 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:35.969825 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:35.969772 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" podStartSLOduration=1.768189204 podStartE2EDuration="5.969757379s" totalImagesPullingTime="3.299696073s" totalInitContainerRuntime="901.872102ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:40:35.968543472 +0000 UTC m=+505.377682043" watchObservedRunningTime="2026-06-05 15:40:35.969757379 +0000 UTC m=+505.378895946" Jun 05 15:40:46.954958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:46.954927 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56f4b89576-9txl8" Jun 05 15:40:52.372641 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.372583 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-656445bd89-qdbkx"] Jun 05 15:40:52.383413 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.383385 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.385905 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.385880 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 15:40:52.386063 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.385993 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 15:40:52.387038 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.387019 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pmzrc\"" Jun 05 15:40:52.387140 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.387079 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 15:40:52.387140 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.387089 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 15:40:52.390548 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.390528 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-656445bd89-qdbkx"] Jun 05 15:40:52.476593 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.476561 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hbzm4"] Jun 05 15:40:52.480860 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.480837 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:52.483328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.483305 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 15:40:52.483479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.483453 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nrb9j\"" Jun 05 15:40:52.491805 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.491785 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hbzm4"] Jun 05 15:40:52.512246 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.512144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37927820-27bc-4821-9c15-6aaffa9151c1-tmp\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.512246 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.512211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46pd\" (UniqueName: \"kubernetes.io/projected/37927820-27bc-4821-9c15-6aaffa9151c1-kube-api-access-j46pd\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.512472 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.512263 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37927820-27bc-4821-9c15-6aaffa9151c1-tls-certs\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.613732 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.613698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-cert\") pod \"odh-model-controller-6dc94f689f-hbzm4\" (UID: \"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8\") " pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:52.613891 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.613806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37927820-27bc-4821-9c15-6aaffa9151c1-tmp\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.613891 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.613867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-875nf\" (UniqueName: \"kubernetes.io/projected/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-kube-api-access-875nf\") pod \"odh-model-controller-6dc94f689f-hbzm4\" (UID: \"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8\") " pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:52.614002 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.613913 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46pd\" (UniqueName: \"kubernetes.io/projected/37927820-27bc-4821-9c15-6aaffa9151c1-kube-api-access-j46pd\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.614002 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.613981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37927820-27bc-4821-9c15-6aaffa9151c1-tls-certs\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.615957 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.615930 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37927820-27bc-4821-9c15-6aaffa9151c1-tmp\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.616338 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.616319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37927820-27bc-4821-9c15-6aaffa9151c1-tls-certs\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.622771 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.622712 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46pd\" (UniqueName: \"kubernetes.io/projected/37927820-27bc-4821-9c15-6aaffa9151c1-kube-api-access-j46pd\") pod \"kube-auth-proxy-656445bd89-qdbkx\" (UID: \"37927820-27bc-4821-9c15-6aaffa9151c1\") " pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.695588 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.695551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" Jun 05 15:40:52.714576 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.714545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-cert\") pod \"odh-model-controller-6dc94f689f-hbzm4\" (UID: \"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8\") " pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:52.714711 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.714646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-875nf\" (UniqueName: \"kubernetes.io/projected/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-kube-api-access-875nf\") pod \"odh-model-controller-6dc94f689f-hbzm4\" (UID: \"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8\") " pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:52.714776 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:40:52.714753 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 05 15:40:52.714844 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:40:52.714832 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-cert podName:a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8 nodeName:}" failed. No retries permitted until 2026-06-05 15:40:53.214809849 +0000 UTC m=+522.623948414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-cert") pod "odh-model-controller-6dc94f689f-hbzm4" (UID: "a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8") : secret "odh-model-controller-webhook-cert" not found Jun 05 15:40:52.723553 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.723525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-875nf\" (UniqueName: \"kubernetes.io/projected/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-kube-api-access-875nf\") pod \"odh-model-controller-6dc94f689f-hbzm4\" (UID: \"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8\") " pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:52.849690 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:52.849659 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-656445bd89-qdbkx"] Jun 05 15:40:52.850469 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:40:52.850442 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37927820_27bc_4821_9c15_6aaffa9151c1.slice/crio-5af5d6329b4c4e80398f3c021eb7b633e72f676b4bbbf290c0d502a48256ab28 WatchSource:0}: Error finding container 5af5d6329b4c4e80398f3c021eb7b633e72f676b4bbbf290c0d502a48256ab28: Status 404 returned error can't find the container with id 5af5d6329b4c4e80398f3c021eb7b633e72f676b4bbbf290c0d502a48256ab28 Jun 05 15:40:53.032251 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.032153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" event={"ID":"37927820-27bc-4821-9c15-6aaffa9151c1","Type":"ContainerStarted","Data":"5af5d6329b4c4e80398f3c021eb7b633e72f676b4bbbf290c0d502a48256ab28"} Jun 05 15:40:53.115890 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.115857 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-84wkt"] Jun 05 15:40:53.121033 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.121015 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:53.123890 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.123871 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 15:40:53.134507 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.134484 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-84wkt"] Jun 05 15:40:53.150711 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.150687 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lpf7v\"" Jun 05 15:40:53.220076 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.220043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmgq\" (UniqueName: \"kubernetes.io/projected/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-kube-api-access-nrmgq\") pod \"model-serving-api-5dd488fc48-84wkt\" (UID: \"7ad2380c-ea0e-42e7-9606-a97ecbe439f9\") " pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:53.220274 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.220102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-tls-certs\") pod \"model-serving-api-5dd488fc48-84wkt\" (UID: \"7ad2380c-ea0e-42e7-9606-a97ecbe439f9\") " pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:53.220274 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.220168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-cert\") pod \"odh-model-controller-6dc94f689f-hbzm4\" (UID: \"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8\") " pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:53.222455 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.222439 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8-cert\") pod \"odh-model-controller-6dc94f689f-hbzm4\" (UID: \"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8\") " pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:53.321465 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.321340 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmgq\" (UniqueName: \"kubernetes.io/projected/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-kube-api-access-nrmgq\") pod \"model-serving-api-5dd488fc48-84wkt\" (UID: \"7ad2380c-ea0e-42e7-9606-a97ecbe439f9\") " pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:53.321465 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.321429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-tls-certs\") pod \"model-serving-api-5dd488fc48-84wkt\" (UID: \"7ad2380c-ea0e-42e7-9606-a97ecbe439f9\") " pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:53.321720 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:40:53.321542 2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 05 15:40:53.321720 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:40:53.321598 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-tls-certs podName:7ad2380c-ea0e-42e7-9606-a97ecbe439f9 nodeName:}" failed. No retries permitted until 2026-06-05 15:40:53.82157966 +0000 UTC m=+523.230718208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-tls-certs") pod "model-serving-api-5dd488fc48-84wkt" (UID: "7ad2380c-ea0e-42e7-9606-a97ecbe439f9") : secret "model-serving-api-tls" not found Jun 05 15:40:53.332943 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.332917 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmgq\" (UniqueName: \"kubernetes.io/projected/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-kube-api-access-nrmgq\") pod \"model-serving-api-5dd488fc48-84wkt\" (UID: \"7ad2380c-ea0e-42e7-9606-a97ecbe439f9\") " pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:53.394608 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.394575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:53.561004 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.560968 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hbzm4"] Jun 05 15:40:53.562780 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:40:53.562744 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e2f2ad_c47d_4c9e_9a0e_6ebbee8c2dd8.slice/crio-c0e260f01fec32846d2d508dc5977268bb55c1e1ff0dd1e8924de3e157736cd4 WatchSource:0}: Error finding container c0e260f01fec32846d2d508dc5977268bb55c1e1ff0dd1e8924de3e157736cd4: Status 404 returned error can't find the container with id c0e260f01fec32846d2d508dc5977268bb55c1e1ff0dd1e8924de3e157736cd4 Jun 05 15:40:53.826364 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.826325 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-tls-certs\") pod \"model-serving-api-5dd488fc48-84wkt\" (UID: \"7ad2380c-ea0e-42e7-9606-a97ecbe439f9\") " pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:53.829526 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:53.829492 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad2380c-ea0e-42e7-9606-a97ecbe439f9-tls-certs\") pod \"model-serving-api-5dd488fc48-84wkt\" (UID: \"7ad2380c-ea0e-42e7-9606-a97ecbe439f9\") " pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:54.031991 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.031953 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:54.043042 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.043005 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" event={"ID":"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8","Type":"ContainerStarted","Data":"c0e260f01fec32846d2d508dc5977268bb55c1e1ff0dd1e8924de3e157736cd4"} Jun 05 15:40:54.166368 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.166323 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl"] Jun 05 15:40:54.172715 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.172587 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.175674 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.175650 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pvz2p\"" Jun 05 15:40:54.175947 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.175927 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:40:54.176455 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.176434 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:40:54.182783 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.182738 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl"] Jun 05 15:40:54.227022 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.226944 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-84wkt"] Jun 05 15:40:54.332981 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.332714 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zj2k\" (UniqueName: \"kubernetes.io/projected/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-kube-api-access-4zj2k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.332981 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.332785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.332981 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.332853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.445139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.440462 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.445139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.440560 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zj2k\" (UniqueName: \"kubernetes.io/projected/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-kube-api-access-4zj2k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.445139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.440596 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.445139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.441029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.445139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.441096 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.455511 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.455455 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zj2k\" (UniqueName: \"kubernetes.io/projected/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-kube-api-access-4zj2k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:54.490987 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:54.490791 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:40:55.054112 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:55.054071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-84wkt" event={"ID":"7ad2380c-ea0e-42e7-9606-a97ecbe439f9","Type":"ContainerStarted","Data":"e733bdd9a764f3cee599030bbb235e206239e2792f74503b32e9fe216f833fbc"} Jun 05 15:40:57.530517 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:57.530448 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl"] Jun 05 15:40:57.536556 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:40:57.536529 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0cf8d3_da31_4a9b_a5a0_1cf6e23554e8.slice/crio-86a542235ddbab9146cf3ea2b2e9081a95aca095eec4c86c4f316c30463c602f WatchSource:0}: Error finding container 86a542235ddbab9146cf3ea2b2e9081a95aca095eec4c86c4f316c30463c602f: Status 404 returned error can't find the container with id 86a542235ddbab9146cf3ea2b2e9081a95aca095eec4c86c4f316c30463c602f Jun 05 15:40:58.075255 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.075223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" event={"ID":"37927820-27bc-4821-9c15-6aaffa9151c1","Type":"ContainerStarted","Data":"d524cf57c47260f7485d9f8eb0d1d606ab1ebf3a2cc05b3ec4b07e7fbc25c7d3"} Jun 05 15:40:58.076965 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.076935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-84wkt" event={"ID":"7ad2380c-ea0e-42e7-9606-a97ecbe439f9","Type":"ContainerStarted","Data":"d7581f6671235a1f66bd4630a152d7211b181d0ae742eece31b6aa930c4d006e"} Jun 05 15:40:58.077088 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.076996 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:40:58.078702 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.078659 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" event={"ID":"a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8","Type":"ContainerStarted","Data":"239287a87d6c2be1f56d03b79d5513f6d7489dec5c9b887ea3205253ff1c4566"} Jun 05 15:40:58.078807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.078723 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:40:58.080393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.080371 2572 generic.go:356] "Generic (PLEG): container finished" podID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerID="44769aa86b37b8f15287bcbe22856901f1fc3690906e624be544ed4096b8666e" exitCode=0 Jun 05 15:40:58.080490 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.080464 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" event={"ID":"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8","Type":"ContainerDied","Data":"44769aa86b37b8f15287bcbe22856901f1fc3690906e624be544ed4096b8666e"} Jun 05 15:40:58.080547 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.080492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" event={"ID":"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8","Type":"ContainerStarted","Data":"86a542235ddbab9146cf3ea2b2e9081a95aca095eec4c86c4f316c30463c602f"} Jun 05 15:40:58.097565 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.097504 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-656445bd89-qdbkx" podStartSLOduration=1.567824957 podStartE2EDuration="6.097485856s" totalImagesPullingTime="4.529660899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:40:58.095162141 +0000 UTC m=+527.504300709" watchObservedRunningTime="2026-06-05 15:40:58.097485856 +0000 UTC m=+527.506624426" Jun 05 15:40:58.137930 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.137867 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" podStartSLOduration=2.280743532 podStartE2EDuration="6.137845588s" totalImagesPullingTime="3.857102056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:40:58.13649975 +0000 UTC m=+527.545638319" watchObservedRunningTime="2026-06-05 15:40:58.137845588 +0000 UTC m=+527.546984157" Jun 05 15:40:58.159435 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:58.159381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-84wkt" podStartSLOduration=1.4193362729999999 podStartE2EDuration="5.159365706s" totalImagesPullingTime="3.740029433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:40:58.15739034 +0000 UTC m=+527.566528910" watchObservedRunningTime="2026-06-05 15:40:58.159365706 +0000 UTC m=+527.568504273" Jun 05 15:40:59.087576 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:59.087537 2572 generic.go:356] "Generic (PLEG): container finished" podID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerID="a9741b1cbe93744aabb98551cbcd869d1f916b15bc1d78be493dbee368f05e8f" exitCode=0 Jun 05 15:40:59.089766 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:40:59.089743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" event={"ID":"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8","Type":"ContainerDied","Data":"a9741b1cbe93744aabb98551cbcd869d1f916b15bc1d78be493dbee368f05e8f"} Jun 05 15:41:00.094760 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:00.094726 2572 generic.go:356] "Generic (PLEG): container finished" podID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerID="f4a168c8bfdd0ae78f992b636c612982e05b748090a63d5e50900e5042f1a5c3" exitCode=0 Jun 05 15:41:00.095136 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:00.094803 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" event={"ID":"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8","Type":"ContainerDied","Data":"f4a168c8bfdd0ae78f992b636c612982e05b748090a63d5e50900e5042f1a5c3"} Jun 05 15:41:01.251111 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.250778 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:41:01.316380 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.316348 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-util\") pod \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " Jun 05 15:41:01.316535 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.316391 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-bundle\") pod \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " Jun 05 15:41:01.316535 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.316438 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zj2k\" (UniqueName: \"kubernetes.io/projected/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-kube-api-access-4zj2k\") pod \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\" (UID: \"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8\") " Jun 05 15:41:01.317226 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.317189 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-bundle" (OuterVolumeSpecName: "bundle") pod "7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" (UID: "7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:41:01.318720 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.318687 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-kube-api-access-4zj2k" (OuterVolumeSpecName: "kube-api-access-4zj2k") pod "7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" (UID: "7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8"). InnerVolumeSpecName "kube-api-access-4zj2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:41:01.322367 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.322344 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-util" (OuterVolumeSpecName: "util") pod "7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" (UID: "7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:41:01.417405 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.417375 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:41:01.417405 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.417399 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:41:01.417405 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:01.417409 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zj2k\" (UniqueName: \"kubernetes.io/projected/7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8-kube-api-access-4zj2k\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:41:02.107105 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:02.107072 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" Jun 05 15:41:02.107105 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:02.107090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wzhrl" event={"ID":"7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8","Type":"ContainerDied","Data":"86a542235ddbab9146cf3ea2b2e9081a95aca095eec4c86c4f316c30463c602f"} Jun 05 15:41:02.107304 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:02.107138 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86a542235ddbab9146cf3ea2b2e9081a95aca095eec4c86c4f316c30463c602f" Jun 05 15:41:03.840124 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840084 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-crgjt"] Jun 05 15:41:03.840607 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840592 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerName="util" Jun 05 15:41:03.840681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840609 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerName="util" Jun 05 15:41:03.840681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840639 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerName="pull" Jun 05 15:41:03.840681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840650 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerName="pull" Jun 05 15:41:03.840681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840663 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerName="extract" Jun 05 15:41:03.840681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840673 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerName="extract" Jun 05 15:41:03.840924 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.840771 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b0cf8d3-da31-4a9b-a5a0-1cf6e23554e8" containerName="extract" Jun 05 15:41:03.849706 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.849681 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:03.851111 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.851090 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4"] Jun 05 15:41:03.852762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.852742 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 15:41:03.852841 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.852751 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rv9kf\"" Jun 05 15:41:03.853777 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.853743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:03.858869 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.858842 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 15:41:03.859067 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.859051 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hkmzz\"" Jun 05 15:41:03.861489 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.861470 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-crgjt"] Jun 05 15:41:03.876732 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.876704 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4"] Jun 05 15:41:03.939997 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.939965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwq78\" (UniqueName: \"kubernetes.io/projected/ed89b0f0-bf4c-4867-b041-b486f77bff34-kube-api-access-zwq78\") pod \"kserve-controller-manager-69fc866d76-crgjt\" (UID: \"ed89b0f0-bf4c-4867-b041-b486f77bff34\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:03.940177 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.940030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8154223a-e19f-43bf-aed2-c885e7179cc6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zntt4\" (UID: \"8154223a-e19f-43bf-aed2-c885e7179cc6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:03.940177 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.940104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed89b0f0-bf4c-4867-b041-b486f77bff34-cert\") pod \"kserve-controller-manager-69fc866d76-crgjt\" (UID: \"ed89b0f0-bf4c-4867-b041-b486f77bff34\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:03.940177 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:03.940152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgtfb\" (UniqueName: \"kubernetes.io/projected/8154223a-e19f-43bf-aed2-c885e7179cc6-kube-api-access-wgtfb\") pod \"llmisvc-controller-manager-864bfd7bc9-zntt4\" (UID: \"8154223a-e19f-43bf-aed2-c885e7179cc6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:04.040981 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.040949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8154223a-e19f-43bf-aed2-c885e7179cc6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zntt4\" (UID: \"8154223a-e19f-43bf-aed2-c885e7179cc6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:04.041168 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.041009 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed89b0f0-bf4c-4867-b041-b486f77bff34-cert\") pod \"kserve-controller-manager-69fc866d76-crgjt\" (UID: \"ed89b0f0-bf4c-4867-b041-b486f77bff34\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:04.041168 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.041039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgtfb\" (UniqueName: \"kubernetes.io/projected/8154223a-e19f-43bf-aed2-c885e7179cc6-kube-api-access-wgtfb\") pod \"llmisvc-controller-manager-864bfd7bc9-zntt4\" (UID: \"8154223a-e19f-43bf-aed2-c885e7179cc6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:04.041168 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.041069 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq78\" (UniqueName: \"kubernetes.io/projected/ed89b0f0-bf4c-4867-b041-b486f77bff34-kube-api-access-zwq78\") pod \"kserve-controller-manager-69fc866d76-crgjt\" (UID: \"ed89b0f0-bf4c-4867-b041-b486f77bff34\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:04.041168 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:41:04.041115 2572 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 15:41:04.041380 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:41:04.041183 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8154223a-e19f-43bf-aed2-c885e7179cc6-cert podName:8154223a-e19f-43bf-aed2-c885e7179cc6 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:04.541163114 +0000 UTC m=+533.950301667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8154223a-e19f-43bf-aed2-c885e7179cc6-cert") pod "llmisvc-controller-manager-864bfd7bc9-zntt4" (UID: "8154223a-e19f-43bf-aed2-c885e7179cc6") : secret "llmisvc-webhook-server-cert" not found Jun 05 15:41:04.043414 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.043396 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed89b0f0-bf4c-4867-b041-b486f77bff34-cert\") pod \"kserve-controller-manager-69fc866d76-crgjt\" (UID: \"ed89b0f0-bf4c-4867-b041-b486f77bff34\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:04.053182 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.053158 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwq78\" (UniqueName: \"kubernetes.io/projected/ed89b0f0-bf4c-4867-b041-b486f77bff34-kube-api-access-zwq78\") pod \"kserve-controller-manager-69fc866d76-crgjt\" (UID: \"ed89b0f0-bf4c-4867-b041-b486f77bff34\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:04.056560 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.056537 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgtfb\" (UniqueName: \"kubernetes.io/projected/8154223a-e19f-43bf-aed2-c885e7179cc6-kube-api-access-wgtfb\") pod \"llmisvc-controller-manager-864bfd7bc9-zntt4\" (UID: \"8154223a-e19f-43bf-aed2-c885e7179cc6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:04.164535 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.164496 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:04.361724 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.361594 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-crgjt"] Jun 05 15:41:04.364518 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:41:04.364494 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded89b0f0_bf4c_4867_b041_b486f77bff34.slice/crio-680ab9c9a0fe444a719f31fa791c9b5c758a1364f6e55242d3d7df5e4c4e2d22 WatchSource:0}: Error finding container 680ab9c9a0fe444a719f31fa791c9b5c758a1364f6e55242d3d7df5e4c4e2d22: Status 404 returned error can't find the container with id 680ab9c9a0fe444a719f31fa791c9b5c758a1364f6e55242d3d7df5e4c4e2d22 Jun 05 15:41:04.544986 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.544909 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8154223a-e19f-43bf-aed2-c885e7179cc6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zntt4\" (UID: \"8154223a-e19f-43bf-aed2-c885e7179cc6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:04.547280 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.547262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8154223a-e19f-43bf-aed2-c885e7179cc6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zntt4\" (UID: \"8154223a-e19f-43bf-aed2-c885e7179cc6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:04.772461 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.772433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:04.901189 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:04.901159 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4"] Jun 05 15:41:04.902562 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:41:04.902539 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8154223a_e19f_43bf_aed2_c885e7179cc6.slice/crio-0d480611e856604d78246a71f64ff88b02b21148c347942d988a320f73140c6f WatchSource:0}: Error finding container 0d480611e856604d78246a71f64ff88b02b21148c347942d988a320f73140c6f: Status 404 returned error can't find the container with id 0d480611e856604d78246a71f64ff88b02b21148c347942d988a320f73140c6f Jun 05 15:41:05.127014 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:05.126963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" event={"ID":"8154223a-e19f-43bf-aed2-c885e7179cc6","Type":"ContainerStarted","Data":"0d480611e856604d78246a71f64ff88b02b21148c347942d988a320f73140c6f"} Jun 05 15:41:05.128734 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:05.128704 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" event={"ID":"ed89b0f0-bf4c-4867-b041-b486f77bff34","Type":"ContainerStarted","Data":"680ab9c9a0fe444a719f31fa791c9b5c758a1364f6e55242d3d7df5e4c4e2d22"} Jun 05 15:41:08.154901 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:08.154858 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" event={"ID":"ed89b0f0-bf4c-4867-b041-b486f77bff34","Type":"ContainerStarted","Data":"d90ac6d22e9cae5b1058df7fb64336ba09fd4a9863838aadce376f5f3610096a"} Jun 05 15:41:08.155461 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:08.154964 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:08.185079 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:08.185023 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" podStartSLOduration=2.212891146 podStartE2EDuration="5.1850031s" totalImagesPullingTime="2.972111954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:08.183422429 +0000 UTC m=+537.592560999" watchObservedRunningTime="2026-06-05 15:41:08.1850031 +0000 UTC m=+537.594141670" Jun 05 15:41:09.090514 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.090484 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-hbzm4" Jun 05 15:41:09.091787 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.091766 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-84wkt" Jun 05 15:41:09.161438 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.161410 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" event={"ID":"8154223a-e19f-43bf-aed2-c885e7179cc6","Type":"ContainerStarted","Data":"dec1505b82574d8cfd4b88c285f1509ce21b8c41bd435a9f7a95da096a9cfb1d"} Jun 05 15:41:09.161950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.161484 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:41:09.344847 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.344776 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp"] Jun 05 15:41:09.348507 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.348490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.375642 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.375606 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:41:09.375797 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.375604 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:41:09.375797 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.375672 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pvz2p\"" Jun 05 15:41:09.392807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.392774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.392928 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.392911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.392976 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.392956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zl5q\" (UniqueName: \"kubernetes.io/projected/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-kube-api-access-8zl5q\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.413886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.413824 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" podStartSLOduration=3.032412779 podStartE2EDuration="6.413804107s" totalImagesPullingTime="3.381391328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:09.413207781 +0000 UTC m=+538.822346380" watchObservedRunningTime="2026-06-05 15:41:09.413804107 +0000 UTC m=+538.822942676" Jun 05 15:41:09.418877 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.418849 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp"] Jun 05 15:41:09.493583 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.493545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.493783 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.493597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zl5q\" (UniqueName: \"kubernetes.io/projected/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-kube-api-access-8zl5q\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.493783 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.493660 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.494028 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.494008 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.494071 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.494029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.519852 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.519825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zl5q\" (UniqueName: \"kubernetes.io/projected/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-kube-api-access-8zl5q\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.657263 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.657220 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:09.817647 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:09.817595 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp"] Jun 05 15:41:09.819344 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:41:09.819313 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66dcb0a1_a3d8_41d5_8aa5_642dd95d7de6.slice/crio-48f6b5ec1c97be2d23ece33db2f9aee0bab2db0186da05432891ebc473159419 WatchSource:0}: Error finding container 48f6b5ec1c97be2d23ece33db2f9aee0bab2db0186da05432891ebc473159419: Status 404 returned error can't find the container with id 48f6b5ec1c97be2d23ece33db2f9aee0bab2db0186da05432891ebc473159419 Jun 05 15:41:10.167978 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.167945 2572 generic.go:356] "Generic (PLEG): container finished" podID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerID="d09286ede8d36017c7136409d0f75bd8446764eabb24b0bbd2725826a0ad3227" exitCode=0 Jun 05 15:41:10.168369 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.168032 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" event={"ID":"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6","Type":"ContainerDied","Data":"d09286ede8d36017c7136409d0f75bd8446764eabb24b0bbd2725826a0ad3227"} Jun 05 15:41:10.168369 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.168091 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" event={"ID":"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6","Type":"ContainerStarted","Data":"48f6b5ec1c97be2d23ece33db2f9aee0bab2db0186da05432891ebc473159419"} Jun 05 15:41:10.941033 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.941006 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-tkv89"] Jun 05 15:41:10.944586 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.944568 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:10.947611 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.947590 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 15:41:10.947709 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.947652 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7kb4b\"" Jun 05 15:41:10.948359 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.948341 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 15:41:10.967139 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:10.967116 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-tkv89"] Jun 05 15:41:11.009509 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.009479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnjcl\" (UniqueName: \"kubernetes.io/projected/c0c9ef1e-8390-4aee-8944-555564c0e0f3-kube-api-access-tnjcl\") pod \"servicemesh-operator3-57f65f65fb-tkv89\" (UID: \"c0c9ef1e-8390-4aee-8944-555564c0e0f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:11.009668 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.009542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c0c9ef1e-8390-4aee-8944-555564c0e0f3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-tkv89\" (UID: \"c0c9ef1e-8390-4aee-8944-555564c0e0f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:11.110992 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.110916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnjcl\" (UniqueName: \"kubernetes.io/projected/c0c9ef1e-8390-4aee-8944-555564c0e0f3-kube-api-access-tnjcl\") pod \"servicemesh-operator3-57f65f65fb-tkv89\" (UID: \"c0c9ef1e-8390-4aee-8944-555564c0e0f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:11.110992 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.110976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c0c9ef1e-8390-4aee-8944-555564c0e0f3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-tkv89\" (UID: \"c0c9ef1e-8390-4aee-8944-555564c0e0f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:11.113386 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.113367 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c0c9ef1e-8390-4aee-8944-555564c0e0f3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-tkv89\" (UID: \"c0c9ef1e-8390-4aee-8944-555564c0e0f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:11.139065 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.139037 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 15:41:11.149736 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.149719 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 15:41:11.159476 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.159448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnjcl\" (UniqueName: \"kubernetes.io/projected/c0c9ef1e-8390-4aee-8944-555564c0e0f3-kube-api-access-tnjcl\") pod \"servicemesh-operator3-57f65f65fb-tkv89\" (UID: \"c0c9ef1e-8390-4aee-8944-555564c0e0f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:11.174347 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.174322 2572 generic.go:356] "Generic (PLEG): container finished" podID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerID="207376c6f347c96f229a1ce21e87afca80be4aa558f5652867f11e14646cdde9" exitCode=0 Jun 05 15:41:11.174761 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.174408 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" event={"ID":"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6","Type":"ContainerDied","Data":"207376c6f347c96f229a1ce21e87afca80be4aa558f5652867f11e14646cdde9"} Jun 05 15:41:11.291336 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.291312 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7kb4b\"" Jun 05 15:41:11.298900 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.298876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:11.454812 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:41:11.454773 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c9ef1e_8390_4aee_8944_555564c0e0f3.slice/crio-a8af41b4a59d973ead1d0a49e8f1d14feb818ba05a1dced3dad57d1e0df5429a WatchSource:0}: Error finding container a8af41b4a59d973ead1d0a49e8f1d14feb818ba05a1dced3dad57d1e0df5429a: Status 404 returned error can't find the container with id a8af41b4a59d973ead1d0a49e8f1d14feb818ba05a1dced3dad57d1e0df5429a Jun 05 15:41:11.454812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:11.454788 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-tkv89"] Jun 05 15:41:12.188322 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:12.188282 2572 generic.go:356] "Generic (PLEG): container finished" podID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerID="5d1adcfd50c561b3859a8ef5ad1684e40f53445172a9c161bd12f5288a992934" exitCode=0 Jun 05 15:41:12.188813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:12.188385 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" event={"ID":"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6","Type":"ContainerDied","Data":"5d1adcfd50c561b3859a8ef5ad1684e40f53445172a9c161bd12f5288a992934"} Jun 05 15:41:12.190378 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:12.190346 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" event={"ID":"c0c9ef1e-8390-4aee-8944-555564c0e0f3","Type":"ContainerStarted","Data":"a8af41b4a59d973ead1d0a49e8f1d14feb818ba05a1dced3dad57d1e0df5429a"} Jun 05 15:41:13.338125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.338103 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:13.433166 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.433128 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-bundle\") pod \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " Jun 05 15:41:13.433395 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.433180 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zl5q\" (UniqueName: \"kubernetes.io/projected/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-kube-api-access-8zl5q\") pod \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " Jun 05 15:41:13.433395 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.433222 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-util\") pod \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\" (UID: \"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6\") " Jun 05 15:41:13.434458 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.434393 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-bundle" (OuterVolumeSpecName: "bundle") pod "66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" (UID: "66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:41:13.436458 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.436428 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-kube-api-access-8zl5q" (OuterVolumeSpecName: "kube-api-access-8zl5q") pod "66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" (UID: "66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6"). InnerVolumeSpecName "kube-api-access-8zl5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:41:13.441643 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.441605 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-util" (OuterVolumeSpecName: "util") pod "66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" (UID: "66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:41:13.534952 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.534877 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:41:13.534952 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.534908 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zl5q\" (UniqueName: \"kubernetes.io/projected/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-kube-api-access-8zl5q\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:41:13.534952 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:13.534923 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:41:14.203341 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:14.203300 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" event={"ID":"66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6","Type":"ContainerDied","Data":"48f6b5ec1c97be2d23ece33db2f9aee0bab2db0186da05432891ebc473159419"} Jun 05 15:41:14.203519 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:14.203360 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48f6b5ec1c97be2d23ece33db2f9aee0bab2db0186da05432891ebc473159419" Jun 05 15:41:14.203519 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:14.203317 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agrwsp" Jun 05 15:41:15.211514 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:15.211478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" event={"ID":"c0c9ef1e-8390-4aee-8944-555564c0e0f3","Type":"ContainerStarted","Data":"f015da0bb5b10ee8065711e02b239e33b5b50f147b4f7860f81b6a4f27dda5c4"} Jun 05 15:41:15.211991 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:15.211657 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:15.263202 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:15.263150 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" podStartSLOduration=2.243202173 podStartE2EDuration="5.263133636s" totalImagesPullingTime="3.019931463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:15.259622451 +0000 UTC m=+544.668761019" watchObservedRunningTime="2026-06-05 15:41:15.263133636 +0000 UTC m=+544.672272204" Jun 05 15:41:22.442549 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442515 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt"] Jun 05 15:41:22.442951 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442879 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerName="pull" Jun 05 15:41:22.442951 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442891 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerName="pull" Jun 05 15:41:22.442951 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442907 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerName="util" Jun 05 15:41:22.442951 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442913 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerName="util" Jun 05 15:41:22.442951 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442928 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerName="extract" Jun 05 15:41:22.442951 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442933 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerName="extract" Jun 05 15:41:22.443130 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.442995 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="66dcb0a1-a3d8-41d5-8aa5-642dd95d7de6" containerName="extract" Jun 05 15:41:22.446291 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.446270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.449215 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.449182 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 15:41:22.449309 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.449286 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 15:41:22.449367 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.449350 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9q9jn\"" Jun 05 15:41:22.449950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.449782 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 15:41:22.449950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.449805 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 15:41:22.460173 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.460153 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt"] Jun 05 15:41:22.619861 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.619825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.619861 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.619863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/80f4b42a-22e7-42b5-a5a9-419031117648-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.620103 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.619893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd4c7\" (UniqueName: \"kubernetes.io/projected/80f4b42a-22e7-42b5-a5a9-419031117648-kube-api-access-xd4c7\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.620103 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.619972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f4b42a-22e7-42b5-a5a9-419031117648-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.620103 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.619999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.620103 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.620022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.620226 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.620104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f4b42a-22e7-42b5-a5a9-419031117648-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721049 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.720974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721049 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.721015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/80f4b42a-22e7-42b5-a5a9-419031117648-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721049 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.721040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd4c7\" (UniqueName: \"kubernetes.io/projected/80f4b42a-22e7-42b5-a5a9-419031117648-kube-api-access-xd4c7\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721357 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.721065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f4b42a-22e7-42b5-a5a9-419031117648-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721357 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.721091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721357 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.721111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721357 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.721139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f4b42a-22e7-42b5-a5a9-419031117648-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.721720 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.721695 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/80f4b42a-22e7-42b5-a5a9-419031117648-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.723523 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.723499 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.723660 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.723531 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/80f4b42a-22e7-42b5-a5a9-419031117648-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.723660 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.723649 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.723779 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.723713 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/80f4b42a-22e7-42b5-a5a9-419031117648-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.730279 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.730255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80f4b42a-22e7-42b5-a5a9-419031117648-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.730461 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.730440 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd4c7\" (UniqueName: \"kubernetes.io/projected/80f4b42a-22e7-42b5-a5a9-419031117648-kube-api-access-xd4c7\") pod \"istiod-openshift-gateway-75c67f8887-c2tmt\" (UID: \"80f4b42a-22e7-42b5-a5a9-419031117648\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.756806 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.756775 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:22.765783 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.765760 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x"] Jun 05 15:41:22.770593 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.770571 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:22.773857 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.773835 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t6gpp\"" Jun 05 15:41:22.773998 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.773962 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 15:41:22.778984 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.778962 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x"] Jun 05 15:41:22.918318 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.918288 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt"] Jun 05 15:41:22.919970 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:41:22.919945 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f4b42a_22e7_42b5_a5a9_419031117648.slice/crio-ce9f83b1dda96f78e2c289802585ca7a061944eeff84cdce1254f887713820d3 WatchSource:0}: Error finding container ce9f83b1dda96f78e2c289802585ca7a061944eeff84cdce1254f887713820d3: Status 404 returned error can't find the container with id ce9f83b1dda96f78e2c289802585ca7a061944eeff84cdce1254f887713820d3 Jun 05 15:41:22.923796 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.923772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/29f1803b-49f9-4121-8d55-45195cae420f-redirect-config\") pod \"dashboard-redirect-6b7b94fdc5-pzs8x\" (UID: \"29f1803b-49f9-4121-8d55-45195cae420f\") " pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:22.923877 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:22.923827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94s87\" (UniqueName: \"kubernetes.io/projected/29f1803b-49f9-4121-8d55-45195cae420f-kube-api-access-94s87\") pod \"dashboard-redirect-6b7b94fdc5-pzs8x\" (UID: \"29f1803b-49f9-4121-8d55-45195cae420f\") " pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:23.025353 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.025257 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/29f1803b-49f9-4121-8d55-45195cae420f-redirect-config\") pod \"dashboard-redirect-6b7b94fdc5-pzs8x\" (UID: \"29f1803b-49f9-4121-8d55-45195cae420f\") " pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:23.025353 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.025314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94s87\" (UniqueName: \"kubernetes.io/projected/29f1803b-49f9-4121-8d55-45195cae420f-kube-api-access-94s87\") pod \"dashboard-redirect-6b7b94fdc5-pzs8x\" (UID: \"29f1803b-49f9-4121-8d55-45195cae420f\") " pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:23.025979 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.025960 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/29f1803b-49f9-4121-8d55-45195cae420f-redirect-config\") pod \"dashboard-redirect-6b7b94fdc5-pzs8x\" (UID: \"29f1803b-49f9-4121-8d55-45195cae420f\") " pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:23.039234 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.039206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94s87\" (UniqueName: \"kubernetes.io/projected/29f1803b-49f9-4121-8d55-45195cae420f-kube-api-access-94s87\") pod \"dashboard-redirect-6b7b94fdc5-pzs8x\" (UID: \"29f1803b-49f9-4121-8d55-45195cae420f\") " pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:23.095636 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.095600 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" Jun 05 15:41:23.236575 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.236548 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x"] Jun 05 15:41:23.238697 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:41:23.238670 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f1803b_49f9_4121_8d55_45195cae420f.slice/crio-ce96fb8532fda67a99a2f870a2952d3377de50e011b0e9433deebf62d7ae36ba WatchSource:0}: Error finding container ce96fb8532fda67a99a2f870a2952d3377de50e011b0e9433deebf62d7ae36ba: Status 404 returned error can't find the container with id ce96fb8532fda67a99a2f870a2952d3377de50e011b0e9433deebf62d7ae36ba Jun 05 15:41:23.255450 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.255422 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" event={"ID":"29f1803b-49f9-4121-8d55-45195cae420f","Type":"ContainerStarted","Data":"ce96fb8532fda67a99a2f870a2952d3377de50e011b0e9433deebf62d7ae36ba"} Jun 05 15:41:23.256743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:23.256722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" event={"ID":"80f4b42a-22e7-42b5-a5a9-419031117648","Type":"ContainerStarted","Data":"ce9f83b1dda96f78e2c289802585ca7a061944eeff84cdce1254f887713820d3"} Jun 05 15:41:26.220576 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:26.220530 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tkv89" Jun 05 15:41:26.398532 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:26.398493 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:41:26.398619 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:26.398577 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:41:27.284493 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:27.284445 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" event={"ID":"29f1803b-49f9-4121-8d55-45195cae420f","Type":"ContainerStarted","Data":"3ccf1fc0442fe3b69d5bd137d7ea8503fe5ea4e864e5b1f9d1ea916f83b6e3cf"} Jun 05 15:41:27.286022 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:27.285996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" event={"ID":"80f4b42a-22e7-42b5-a5a9-419031117648","Type":"ContainerStarted","Data":"9b76ba76f7eb835c2dd39cdddf467e319756d5a37398ca03a3c4c86569c8821a"} Jun 05 15:41:27.286101 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:27.286047 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:27.287693 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:27.287670 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-c2tmt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 15:41:27.287805 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:27.287713 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" podUID="80f4b42a-22e7-42b5-a5a9-419031117648" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:41:27.317799 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:27.317750 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6b7b94fdc5-pzs8x" podStartSLOduration=1.764589756 podStartE2EDuration="5.317735969s" totalImagesPullingTime="3.553146213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:27.315221698 +0000 UTC m=+556.724360266" watchObservedRunningTime="2026-06-05 15:41:27.317735969 +0000 UTC m=+556.726874515" Jun 05 15:41:27.339082 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:27.339004 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" podStartSLOduration=1.862864343 podStartE2EDuration="5.33899101s" totalImagesPullingTime="3.476126667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:27.336823131 +0000 UTC m=+556.745961701" watchObservedRunningTime="2026-06-05 15:41:27.33899101 +0000 UTC m=+556.748129579" Jun 05 15:41:28.293950 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:28.293911 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-c2tmt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 15:41:28.294323 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:28.293975 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" podUID="80f4b42a-22e7-42b5-a5a9-419031117648" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:41:31.294438 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:31.294409 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-c2tmt" Jun 05 15:41:39.166476 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:39.166442 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-crgjt" Jun 05 15:41:40.170410 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:41:40.170380 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zntt4" Jun 05 15:42:06.109718 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.109683 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87"] Jun 05 15:42:06.122614 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.122584 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87"] Jun 05 15:42:06.122754 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.122709 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.125475 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.125450 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4cpq6\"" Jun 05 15:42:06.125694 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.125484 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 15:42:06.126528 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.126510 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 15:42:06.206367 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.206338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.206533 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.206438 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mqhh\" (UniqueName: \"kubernetes.io/projected/ace825e9-2895-43af-a2a3-0ff0790d715e-kube-api-access-5mqhh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.206533 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.206472 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.307341 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.307315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.307479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.307385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mqhh\" (UniqueName: \"kubernetes.io/projected/ace825e9-2895-43af-a2a3-0ff0790d715e-kube-api-access-5mqhh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.307479 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.307421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.307813 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.307794 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.307861 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.307813 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.316245 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.316225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mqhh\" (UniqueName: \"kubernetes.io/projected/ace825e9-2895-43af-a2a3-0ff0790d715e-kube-api-access-5mqhh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.433618 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.433575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:06.566469 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.566446 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87"] Jun 05 15:42:06.568390 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:42:06.568367 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace825e9_2895_43af_a2a3_0ff0790d715e.slice/crio-56af1ba7ff802850cd7e74d0eed924032a98d67c4707623e151c4df08423d098 WatchSource:0}: Error finding container 56af1ba7ff802850cd7e74d0eed924032a98d67c4707623e151c4df08423d098: Status 404 returned error can't find the container with id 56af1ba7ff802850cd7e74d0eed924032a98d67c4707623e151c4df08423d098 Jun 05 15:42:06.712233 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.712178 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc"] Jun 05 15:42:06.715719 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.715700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.725034 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.725011 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc"] Jun 05 15:42:06.813257 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.813231 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.813397 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.813262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.813397 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.813287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/196b0481-f356-4b8a-8f7c-333bbf43ee13-kube-api-access-vz9gc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.914511 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.914480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.914652 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.914516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.914652 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.914536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/196b0481-f356-4b8a-8f7c-333bbf43ee13-kube-api-access-vz9gc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.914877 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.914857 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.914924 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.914890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:06.923294 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:06.923276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/196b0481-f356-4b8a-8f7c-333bbf43ee13-kube-api-access-vz9gc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:07.037279 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.037213 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:07.168555 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.168530 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc"] Jun 05 15:42:07.170019 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:42:07.169997 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196b0481_f356_4b8a_8f7c_333bbf43ee13.slice/crio-e4cfb4450d0b28ad53bc1eb70da4ad163658091c81dc4e0db39d1926aabadd82 WatchSource:0}: Error finding container e4cfb4450d0b28ad53bc1eb70da4ad163658091c81dc4e0db39d1926aabadd82: Status 404 returned error can't find the container with id e4cfb4450d0b28ad53bc1eb70da4ad163658091c81dc4e0db39d1926aabadd82 Jun 05 15:42:07.320725 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.320654 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq"] Jun 05 15:42:07.324449 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.324433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.334392 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.334362 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq"] Jun 05 15:42:07.420045 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.420010 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.420201 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.420073 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.420201 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.420095 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8mt2\" (UniqueName: \"kubernetes.io/projected/f3cec3fb-f935-4d01-b848-20eeacbb5197-kube-api-access-f8mt2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.513245 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.513211 2572 generic.go:356] "Generic (PLEG): container finished" podID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerID="67b822e8adcd0b215b734f6cee19fb66fbabb9c2fe7d1c6856b45ec388bed1a7" exitCode=0 Jun 05 15:42:07.513400 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.513288 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" event={"ID":"ace825e9-2895-43af-a2a3-0ff0790d715e","Type":"ContainerDied","Data":"67b822e8adcd0b215b734f6cee19fb66fbabb9c2fe7d1c6856b45ec388bed1a7"} Jun 05 15:42:07.513400 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.513357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" event={"ID":"ace825e9-2895-43af-a2a3-0ff0790d715e","Type":"ContainerStarted","Data":"56af1ba7ff802850cd7e74d0eed924032a98d67c4707623e151c4df08423d098"} Jun 05 15:42:07.514947 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.514917 2572 generic.go:356] "Generic (PLEG): container finished" podID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerID="5473de7095dd7bf2ffeadef0abd35652a91b0990c783688a98a6d9d0b53a2c89" exitCode=0 Jun 05 15:42:07.515012 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.514988 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" event={"ID":"196b0481-f356-4b8a-8f7c-333bbf43ee13","Type":"ContainerDied","Data":"5473de7095dd7bf2ffeadef0abd35652a91b0990c783688a98a6d9d0b53a2c89"} Jun 05 15:42:07.515054 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.515015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" event={"ID":"196b0481-f356-4b8a-8f7c-333bbf43ee13","Type":"ContainerStarted","Data":"e4cfb4450d0b28ad53bc1eb70da4ad163658091c81dc4e0db39d1926aabadd82"} Jun 05 15:42:07.520900 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.520871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.521009 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.520940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.521009 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.520973 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8mt2\" (UniqueName: \"kubernetes.io/projected/f3cec3fb-f935-4d01-b848-20eeacbb5197-kube-api-access-f8mt2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.521257 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.521240 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.521307 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.521271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.529591 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.529565 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8mt2\" (UniqueName: \"kubernetes.io/projected/f3cec3fb-f935-4d01-b848-20eeacbb5197-kube-api-access-f8mt2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.649007 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.648979 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:07.715439 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.715409 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt"] Jun 05 15:42:07.719678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.719657 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.726534 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.726513 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt"] Jun 05 15:42:07.793327 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.793297 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq"] Jun 05 15:42:07.794835 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:42:07.794804 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cec3fb_f935_4d01_b848_20eeacbb5197.slice/crio-b00051a647dc21483b4eadba50d080fa95d35fcb3ff0abe7ccf617373cc38fec WatchSource:0}: Error finding container b00051a647dc21483b4eadba50d080fa95d35fcb3ff0abe7ccf617373cc38fec: Status 404 returned error can't find the container with id b00051a647dc21483b4eadba50d080fa95d35fcb3ff0abe7ccf617373cc38fec Jun 05 15:42:07.824445 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.824420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7q6w\" (UniqueName: \"kubernetes.io/projected/54843bb4-792b-4479-8a4c-c7ba7845cd93-kube-api-access-q7q6w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.824568 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.824548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.824653 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.824609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.925878 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.925818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.925878 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.925858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.926040 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.925968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7q6w\" (UniqueName: \"kubernetes.io/projected/54843bb4-792b-4479-8a4c-c7ba7845cd93-kube-api-access-q7q6w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.926170 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.926155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.926233 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.926194 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:07.934834 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:07.934813 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7q6w\" (UniqueName: \"kubernetes.io/projected/54843bb4-792b-4479-8a4c-c7ba7845cd93-kube-api-access-q7q6w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:08.031046 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.031015 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:08.177741 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.177710 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt"] Jun 05 15:42:08.181718 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:42:08.181692 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54843bb4_792b_4479_8a4c_c7ba7845cd93.slice/crio-28929db033010e9c2a7fd76b72f30aa161367ddbfbe31795e34c14da60791d68 WatchSource:0}: Error finding container 28929db033010e9c2a7fd76b72f30aa161367ddbfbe31795e34c14da60791d68: Status 404 returned error can't find the container with id 28929db033010e9c2a7fd76b72f30aa161367ddbfbe31795e34c14da60791d68 Jun 05 15:42:08.522645 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.522601 2572 generic.go:356] "Generic (PLEG): container finished" podID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerID="6f0d59c15984866b51e6f6eb2ad028abf1638c1edd4786baa1f0686e5884e010" exitCode=0 Jun 05 15:42:08.522755 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.522668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" event={"ID":"ace825e9-2895-43af-a2a3-0ff0790d715e","Type":"ContainerDied","Data":"6f0d59c15984866b51e6f6eb2ad028abf1638c1edd4786baa1f0686e5884e010"} Jun 05 15:42:08.524583 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.524558 2572 generic.go:356] "Generic (PLEG): container finished" podID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerID="59fdc71c5ddd8f052609ad38968fe378ec9602231fb0afbb9c4152a57bc3af80" exitCode=0 Jun 05 15:42:08.524702 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.524666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" event={"ID":"196b0481-f356-4b8a-8f7c-333bbf43ee13","Type":"ContainerDied","Data":"59fdc71c5ddd8f052609ad38968fe378ec9602231fb0afbb9c4152a57bc3af80"} Jun 05 15:42:08.526240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.526217 2572 generic.go:356] "Generic (PLEG): container finished" podID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerID="777090433f68ef96b2d071c6879662c5e6232f2272e0da8570c3a98dd7b8958a" exitCode=0 Jun 05 15:42:08.526376 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.526339 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" event={"ID":"54843bb4-792b-4479-8a4c-c7ba7845cd93","Type":"ContainerDied","Data":"777090433f68ef96b2d071c6879662c5e6232f2272e0da8570c3a98dd7b8958a"} Jun 05 15:42:08.526451 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.526400 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" event={"ID":"54843bb4-792b-4479-8a4c-c7ba7845cd93","Type":"ContainerStarted","Data":"28929db033010e9c2a7fd76b72f30aa161367ddbfbe31795e34c14da60791d68"} Jun 05 15:42:08.528399 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.528379 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerID="0ec363011d54da3c2b6ba5dcb34a2a20af960e15c981b8411b5a29047969e47c" exitCode=0 Jun 05 15:42:08.528453 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.528405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" event={"ID":"f3cec3fb-f935-4d01-b848-20eeacbb5197","Type":"ContainerDied","Data":"0ec363011d54da3c2b6ba5dcb34a2a20af960e15c981b8411b5a29047969e47c"} Jun 05 15:42:08.528453 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:08.528439 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" event={"ID":"f3cec3fb-f935-4d01-b848-20eeacbb5197","Type":"ContainerStarted","Data":"b00051a647dc21483b4eadba50d080fa95d35fcb3ff0abe7ccf617373cc38fec"} Jun 05 15:42:09.536649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.536540 2572 generic.go:356] "Generic (PLEG): container finished" podID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerID="603744ce2e355266dcd713dd69635fb8e659884b908cc3fac9b22859dac12182" exitCode=0 Jun 05 15:42:09.536649 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.536611 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" event={"ID":"196b0481-f356-4b8a-8f7c-333bbf43ee13","Type":"ContainerDied","Data":"603744ce2e355266dcd713dd69635fb8e659884b908cc3fac9b22859dac12182"} Jun 05 15:42:09.538454 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.538430 2572 generic.go:356] "Generic (PLEG): container finished" podID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerID="d6d5727375e2648eadbd368b2691a85bc09ba62dd5f7c83f08f7f7a0a9bb59af" exitCode=0 Jun 05 15:42:09.538578 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.538507 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" event={"ID":"54843bb4-792b-4479-8a4c-c7ba7845cd93","Type":"ContainerDied","Data":"d6d5727375e2648eadbd368b2691a85bc09ba62dd5f7c83f08f7f7a0a9bb59af"} Jun 05 15:42:09.540196 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.540176 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerID="968ddfd93317d57ae8e826daa64a4194f701e547148b0c81293be94d64ce3030" exitCode=0 Jun 05 15:42:09.540299 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.540271 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" event={"ID":"f3cec3fb-f935-4d01-b848-20eeacbb5197","Type":"ContainerDied","Data":"968ddfd93317d57ae8e826daa64a4194f701e547148b0c81293be94d64ce3030"} Jun 05 15:42:09.542614 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.542596 2572 generic.go:356] "Generic (PLEG): container finished" podID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerID="e5f5db693946481b357e6d34fd1daa2cc0f1778237880ba41a192333dc3eccb2" exitCode=0 Jun 05 15:42:09.542713 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:09.542646 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" event={"ID":"ace825e9-2895-43af-a2a3-0ff0790d715e","Type":"ContainerDied","Data":"e5f5db693946481b357e6d34fd1daa2cc0f1778237880ba41a192333dc3eccb2"} Jun 05 15:42:10.549837 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.549799 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerID="42ee60b509db4e76c1ee22957853bc943d9624158a5fbb4b02661c1d1b4e6e73" exitCode=0 Jun 05 15:42:10.550298 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.549880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" event={"ID":"f3cec3fb-f935-4d01-b848-20eeacbb5197","Type":"ContainerDied","Data":"42ee60b509db4e76c1ee22957853bc943d9624158a5fbb4b02661c1d1b4e6e73"} Jun 05 15:42:10.552187 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.552165 2572 generic.go:356] "Generic (PLEG): container finished" podID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerID="6c3b6879a2befc618a5338499b949b38bd90cfc9294b8af91791696f47028f1f" exitCode=0 Jun 05 15:42:10.552271 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.552233 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" event={"ID":"54843bb4-792b-4479-8a4c-c7ba7845cd93","Type":"ContainerDied","Data":"6c3b6879a2befc618a5338499b949b38bd90cfc9294b8af91791696f47028f1f"} Jun 05 15:42:10.698828 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.698804 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:10.724849 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.724828 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:10.850965 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.850877 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/196b0481-f356-4b8a-8f7c-333bbf43ee13-kube-api-access-vz9gc\") pod \"196b0481-f356-4b8a-8f7c-333bbf43ee13\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " Jun 05 15:42:10.851117 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.850970 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-util\") pod \"ace825e9-2895-43af-a2a3-0ff0790d715e\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " Jun 05 15:42:10.851117 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.850999 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-bundle\") pod \"ace825e9-2895-43af-a2a3-0ff0790d715e\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " Jun 05 15:42:10.851117 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.851018 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-bundle\") pod \"196b0481-f356-4b8a-8f7c-333bbf43ee13\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " Jun 05 15:42:10.851117 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.851037 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mqhh\" (UniqueName: \"kubernetes.io/projected/ace825e9-2895-43af-a2a3-0ff0790d715e-kube-api-access-5mqhh\") pod \"ace825e9-2895-43af-a2a3-0ff0790d715e\" (UID: \"ace825e9-2895-43af-a2a3-0ff0790d715e\") " Jun 05 15:42:10.851117 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.851065 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-util\") pod \"196b0481-f356-4b8a-8f7c-333bbf43ee13\" (UID: \"196b0481-f356-4b8a-8f7c-333bbf43ee13\") " Jun 05 15:42:10.851663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.851581 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-bundle" (OuterVolumeSpecName: "bundle") pod "ace825e9-2895-43af-a2a3-0ff0790d715e" (UID: "ace825e9-2895-43af-a2a3-0ff0790d715e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:10.851809 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.851776 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-bundle" (OuterVolumeSpecName: "bundle") pod "196b0481-f356-4b8a-8f7c-333bbf43ee13" (UID: "196b0481-f356-4b8a-8f7c-333bbf43ee13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:10.853305 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.853282 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ace825e9-2895-43af-a2a3-0ff0790d715e-kube-api-access-5mqhh" (OuterVolumeSpecName: "kube-api-access-5mqhh") pod "ace825e9-2895-43af-a2a3-0ff0790d715e" (UID: "ace825e9-2895-43af-a2a3-0ff0790d715e"). InnerVolumeSpecName "kube-api-access-5mqhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:42:10.853370 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.853303 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/196b0481-f356-4b8a-8f7c-333bbf43ee13-kube-api-access-vz9gc" (OuterVolumeSpecName: "kube-api-access-vz9gc") pod "196b0481-f356-4b8a-8f7c-333bbf43ee13" (UID: "196b0481-f356-4b8a-8f7c-333bbf43ee13"). InnerVolumeSpecName "kube-api-access-vz9gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:42:10.859680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.859651 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-util" (OuterVolumeSpecName: "util") pod "196b0481-f356-4b8a-8f7c-333bbf43ee13" (UID: "196b0481-f356-4b8a-8f7c-333bbf43ee13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:10.859861 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.859846 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-util" (OuterVolumeSpecName: "util") pod "ace825e9-2895-43af-a2a3-0ff0790d715e" (UID: "ace825e9-2895-43af-a2a3-0ff0790d715e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:10.952728 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.952706 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:10.952728 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.952728 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ace825e9-2895-43af-a2a3-0ff0790d715e-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:10.952870 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.952739 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:10.952870 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.952748 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mqhh\" (UniqueName: \"kubernetes.io/projected/ace825e9-2895-43af-a2a3-0ff0790d715e-kube-api-access-5mqhh\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:10.952870 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.952756 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196b0481-f356-4b8a-8f7c-333bbf43ee13-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:10.952870 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:10.952765 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/196b0481-f356-4b8a-8f7c-333bbf43ee13-kube-api-access-vz9gc\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:11.077974 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.077928 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:42:11.078466 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.078450 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:42:11.085830 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.085809 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:42:11.085959 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.085889 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:42:11.560125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.560093 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" Jun 05 15:42:11.560125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.560113 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc" event={"ID":"196b0481-f356-4b8a-8f7c-333bbf43ee13","Type":"ContainerDied","Data":"e4cfb4450d0b28ad53bc1eb70da4ad163658091c81dc4e0db39d1926aabadd82"} Jun 05 15:42:11.560678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.560195 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4cfb4450d0b28ad53bc1eb70da4ad163658091c81dc4e0db39d1926aabadd82" Jun 05 15:42:11.562193 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.562160 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" event={"ID":"ace825e9-2895-43af-a2a3-0ff0790d715e","Type":"ContainerDied","Data":"56af1ba7ff802850cd7e74d0eed924032a98d67c4707623e151c4df08423d098"} Jun 05 15:42:11.562394 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.562259 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56af1ba7ff802850cd7e74d0eed924032a98d67c4707623e151c4df08423d098" Jun 05 15:42:11.562394 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.562174 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87" Jun 05 15:42:11.726215 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.726190 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:11.729127 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.729100 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:11.868691 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.868665 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-bundle\") pod \"54843bb4-792b-4479-8a4c-c7ba7845cd93\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " Jun 05 15:42:11.868843 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.868750 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7q6w\" (UniqueName: \"kubernetes.io/projected/54843bb4-792b-4479-8a4c-c7ba7845cd93-kube-api-access-q7q6w\") pod \"54843bb4-792b-4479-8a4c-c7ba7845cd93\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " Jun 05 15:42:11.868843 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.868781 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-bundle\") pod \"f3cec3fb-f935-4d01-b848-20eeacbb5197\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " Jun 05 15:42:11.868843 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.868795 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-util\") pod \"f3cec3fb-f935-4d01-b848-20eeacbb5197\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " Jun 05 15:42:11.868843 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.868810 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-util\") pod \"54843bb4-792b-4479-8a4c-c7ba7845cd93\" (UID: \"54843bb4-792b-4479-8a4c-c7ba7845cd93\") " Jun 05 15:42:11.869063 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.868853 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8mt2\" (UniqueName: \"kubernetes.io/projected/f3cec3fb-f935-4d01-b848-20eeacbb5197-kube-api-access-f8mt2\") pod \"f3cec3fb-f935-4d01-b848-20eeacbb5197\" (UID: \"f3cec3fb-f935-4d01-b848-20eeacbb5197\") " Jun 05 15:42:11.869272 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.869245 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-bundle" (OuterVolumeSpecName: "bundle") pod "54843bb4-792b-4479-8a4c-c7ba7845cd93" (UID: "54843bb4-792b-4479-8a4c-c7ba7845cd93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:11.869413 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.869323 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-bundle" (OuterVolumeSpecName: "bundle") pod "f3cec3fb-f935-4d01-b848-20eeacbb5197" (UID: "f3cec3fb-f935-4d01-b848-20eeacbb5197"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:11.871050 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.871027 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54843bb4-792b-4479-8a4c-c7ba7845cd93-kube-api-access-q7q6w" (OuterVolumeSpecName: "kube-api-access-q7q6w") pod "54843bb4-792b-4479-8a4c-c7ba7845cd93" (UID: "54843bb4-792b-4479-8a4c-c7ba7845cd93"). InnerVolumeSpecName "kube-api-access-q7q6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:42:11.871333 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.871312 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3cec3fb-f935-4d01-b848-20eeacbb5197-kube-api-access-f8mt2" (OuterVolumeSpecName: "kube-api-access-f8mt2") pod "f3cec3fb-f935-4d01-b848-20eeacbb5197" (UID: "f3cec3fb-f935-4d01-b848-20eeacbb5197"). InnerVolumeSpecName "kube-api-access-f8mt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:42:11.874676 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.874649 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-util" (OuterVolumeSpecName: "util") pod "54843bb4-792b-4479-8a4c-c7ba7845cd93" (UID: "54843bb4-792b-4479-8a4c-c7ba7845cd93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:11.877549 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.877521 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-util" (OuterVolumeSpecName: "util") pod "f3cec3fb-f935-4d01-b848-20eeacbb5197" (UID: "f3cec3fb-f935-4d01-b848-20eeacbb5197"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:42:11.970540 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.970513 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:11.970540 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.970538 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7q6w\" (UniqueName: \"kubernetes.io/projected/54843bb4-792b-4479-8a4c-c7ba7845cd93-kube-api-access-q7q6w\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:11.970698 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.970549 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:11.970698 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.970557 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cec3fb-f935-4d01-b848-20eeacbb5197-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:11.970698 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.970566 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54843bb4-792b-4479-8a4c-c7ba7845cd93-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:11.970698 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:11.970573 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8mt2\" (UniqueName: \"kubernetes.io/projected/f3cec3fb-f935-4d01-b848-20eeacbb5197-kube-api-access-f8mt2\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:12.569523 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:12.569449 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" Jun 05 15:42:12.569959 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:12.569542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt" event={"ID":"54843bb4-792b-4479-8a4c-c7ba7845cd93","Type":"ContainerDied","Data":"28929db033010e9c2a7fd76b72f30aa161367ddbfbe31795e34c14da60791d68"} Jun 05 15:42:12.569959 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:12.569592 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28929db033010e9c2a7fd76b72f30aa161367ddbfbe31795e34c14da60791d68" Jun 05 15:42:12.571670 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:12.571652 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" Jun 05 15:42:12.571670 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:12.571654 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq" event={"ID":"f3cec3fb-f935-4d01-b848-20eeacbb5197","Type":"ContainerDied","Data":"b00051a647dc21483b4eadba50d080fa95d35fcb3ff0abe7ccf617373cc38fec"} Jun 05 15:42:12.571831 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:12.571690 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b00051a647dc21483b4eadba50d080fa95d35fcb3ff0abe7ccf617373cc38fec" Jun 05 15:42:22.885490 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:22.885446 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f78d75b9b-5q79v"] Jun 05 15:42:26.227347 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227311 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd"] Jun 05 15:42:26.227743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227702 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerName="extract" Jun 05 15:42:26.227743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227714 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerName="extract" Jun 05 15:42:26.227743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227724 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerName="util" Jun 05 15:42:26.227743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227729 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerName="util" Jun 05 15:42:26.227743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227744 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227750 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227755 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerName="extract" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227762 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerName="extract" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227775 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerName="extract" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227781 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerName="extract" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227787 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerName="util" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227792 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerName="util" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227798 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227802 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227809 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227814 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227819 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerName="util" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227824 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerName="util" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227828 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerName="util" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227833 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerName="util" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227838 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227842 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerName="pull" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227848 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerName="extract" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227853 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerName="extract" Jun 05 15:42:26.227907 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227910 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ace825e9-2895-43af-a2a3-0ff0790d715e" containerName="extract" Jun 05 15:42:26.228463 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227918 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3cec3fb-f935-4d01-b848-20eeacbb5197" containerName="extract" Jun 05 15:42:26.228463 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227926 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="196b0481-f356-4b8a-8f7c-333bbf43ee13" containerName="extract" Jun 05 15:42:26.228463 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.227932 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="54843bb4-792b-4479-8a4c-c7ba7845cd93" containerName="extract" Jun 05 15:42:26.231020 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.231003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:26.233560 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.233537 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 15:42:26.234590 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.234575 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 15:42:26.234676 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.234598 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fczrz\"" Jun 05 15:42:26.240138 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.240110 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd"] Jun 05 15:42:26.285720 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.285680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncvcz\" (UniqueName: \"kubernetes.io/projected/17d61fc0-20e5-4e38-bc73-4b3d5ac52802-kube-api-access-ncvcz\") pod \"limitador-operator-controller-manager-859d7b78bd-7jlmd\" (UID: \"17d61fc0-20e5-4e38-bc73-4b3d5ac52802\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:26.387008 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.386972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncvcz\" (UniqueName: \"kubernetes.io/projected/17d61fc0-20e5-4e38-bc73-4b3d5ac52802-kube-api-access-ncvcz\") pod \"limitador-operator-controller-manager-859d7b78bd-7jlmd\" (UID: \"17d61fc0-20e5-4e38-bc73-4b3d5ac52802\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:26.396519 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.396488 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncvcz\" (UniqueName: \"kubernetes.io/projected/17d61fc0-20e5-4e38-bc73-4b3d5ac52802-kube-api-access-ncvcz\") pod \"limitador-operator-controller-manager-859d7b78bd-7jlmd\" (UID: \"17d61fc0-20e5-4e38-bc73-4b3d5ac52802\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:26.543282 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.543191 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:26.689741 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:26.689712 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd"] Jun 05 15:42:26.690564 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:42:26.690539 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d61fc0_20e5_4e38_bc73_4b3d5ac52802.slice/crio-638ff3e92d2cae1ff00ad32881033c58aaaed4ecf7dfd93d08ade7b38f52b655 WatchSource:0}: Error finding container 638ff3e92d2cae1ff00ad32881033c58aaaed4ecf7dfd93d08ade7b38f52b655: Status 404 returned error can't find the container with id 638ff3e92d2cae1ff00ad32881033c58aaaed4ecf7dfd93d08ade7b38f52b655 Jun 05 15:42:27.665927 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:27.665883 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" event={"ID":"17d61fc0-20e5-4e38-bc73-4b3d5ac52802","Type":"ContainerStarted","Data":"638ff3e92d2cae1ff00ad32881033c58aaaed4ecf7dfd93d08ade7b38f52b655"} Jun 05 15:42:29.679187 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:29.679146 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" event={"ID":"17d61fc0-20e5-4e38-bc73-4b3d5ac52802","Type":"ContainerStarted","Data":"5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a"} Jun 05 15:42:29.679773 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:29.679343 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:29.702164 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:29.702099 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" podStartSLOduration=1.701771648 podStartE2EDuration="3.702082183s" totalImagesPullingTime="2.000310535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:42:29.699798714 +0000 UTC m=+619.108937285" watchObservedRunningTime="2026-06-05 15:42:29.702082183 +0000 UTC m=+619.111220751" Jun 05 15:42:38.736266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.736229 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd"] Jun 05 15:42:38.736909 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.736530 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" containerName="manager" containerID="cri-o://5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a" gracePeriod=2 Jun 05 15:42:38.740167 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.740141 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:38.742785 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.742761 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd"] Jun 05 15:42:38.754035 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:42:38.754007 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jlmd\" is forbidden: User \"system:node:ip-10-0-140-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-178.ec2.internal' and this object" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:38.770932 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.770907 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4"] Jun 05 15:42:38.771449 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.771432 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" containerName="manager" Jun 05 15:42:38.771449 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.771450 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" containerName="manager" Jun 05 15:42:38.771591 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.771523 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" containerName="manager" Jun 05 15:42:38.774676 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.774656 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" Jun 05 15:42:38.777521 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:42:38.777486 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jlmd\" is forbidden: User \"system:node:ip-10-0-140-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-178.ec2.internal' and this object" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:38.785888 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.785863 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4"] Jun 05 15:42:38.902379 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.902339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfgzt\" (UniqueName: \"kubernetes.io/projected/6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6-kube-api-access-tfgzt\") pod \"limitador-operator-controller-manager-859d7b78bd-7m8h4\" (UID: \"6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" Jun 05 15:42:38.979234 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:38.979212 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:38.981575 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:42:38.981550 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jlmd\" is forbidden: User \"system:node:ip-10-0-140-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-178.ec2.internal' and this object" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:39.003159 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.003103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfgzt\" (UniqueName: \"kubernetes.io/projected/6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6-kube-api-access-tfgzt\") pod \"limitador-operator-controller-manager-859d7b78bd-7m8h4\" (UID: \"6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" Jun 05 15:42:39.018058 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.018032 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfgzt\" (UniqueName: \"kubernetes.io/projected/6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6-kube-api-access-tfgzt\") pod \"limitador-operator-controller-manager-859d7b78bd-7m8h4\" (UID: \"6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" Jun 05 15:42:39.103776 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.103752 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncvcz\" (UniqueName: \"kubernetes.io/projected/17d61fc0-20e5-4e38-bc73-4b3d5ac52802-kube-api-access-ncvcz\") pod \"17d61fc0-20e5-4e38-bc73-4b3d5ac52802\" (UID: \"17d61fc0-20e5-4e38-bc73-4b3d5ac52802\") " Jun 05 15:42:39.105596 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.105569 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17d61fc0-20e5-4e38-bc73-4b3d5ac52802-kube-api-access-ncvcz" (OuterVolumeSpecName: "kube-api-access-ncvcz") pod "17d61fc0-20e5-4e38-bc73-4b3d5ac52802" (UID: "17d61fc0-20e5-4e38-bc73-4b3d5ac52802"). InnerVolumeSpecName "kube-api-access-ncvcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:42:39.116728 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.116706 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" Jun 05 15:42:39.157285 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.157254 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl"] Jun 05 15:42:39.161943 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.161916 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.165413 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.165389 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68srq\"" Jun 05 15:42:39.175145 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.175059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl"] Jun 05 15:42:39.204415 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.204392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxdlb\" (UniqueName: \"kubernetes.io/projected/1dfb826f-576a-4acb-93f2-5a372c9a9e7d-kube-api-access-zxdlb\") pod \"kuadrant-operator-controller-manager-86878c769f-6h5tl\" (UID: \"1dfb826f-576a-4acb-93f2-5a372c9a9e7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.204475 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.204428 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfb826f-576a-4acb-93f2-5a372c9a9e7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6h5tl\" (UID: \"1dfb826f-576a-4acb-93f2-5a372c9a9e7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.204475 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.204470 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncvcz\" (UniqueName: \"kubernetes.io/projected/17d61fc0-20e5-4e38-bc73-4b3d5ac52802-kube-api-access-ncvcz\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:39.260508 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.260483 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4"] Jun 05 15:42:39.263211 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:42:39.263164 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed2accb_d8bf_4a4a_89dd_09fb2e7b67e6.slice/crio-8f6e4f984125eef2b6ee7612a65de5c9a86ddb490b23177b4dce8792a70eacd7 WatchSource:0}: Error finding container 8f6e4f984125eef2b6ee7612a65de5c9a86ddb490b23177b4dce8792a70eacd7: Status 404 returned error can't find the container with id 8f6e4f984125eef2b6ee7612a65de5c9a86ddb490b23177b4dce8792a70eacd7 Jun 05 15:42:39.305661 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.305621 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxdlb\" (UniqueName: \"kubernetes.io/projected/1dfb826f-576a-4acb-93f2-5a372c9a9e7d-kube-api-access-zxdlb\") pod \"kuadrant-operator-controller-manager-86878c769f-6h5tl\" (UID: \"1dfb826f-576a-4acb-93f2-5a372c9a9e7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.305750 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.305686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfb826f-576a-4acb-93f2-5a372c9a9e7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6h5tl\" (UID: \"1dfb826f-576a-4acb-93f2-5a372c9a9e7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.306053 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.306032 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dfb826f-576a-4acb-93f2-5a372c9a9e7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6h5tl\" (UID: \"1dfb826f-576a-4acb-93f2-5a372c9a9e7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.314984 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.314958 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxdlb\" (UniqueName: \"kubernetes.io/projected/1dfb826f-576a-4acb-93f2-5a372c9a9e7d-kube-api-access-zxdlb\") pod \"kuadrant-operator-controller-manager-86878c769f-6h5tl\" (UID: \"1dfb826f-576a-4acb-93f2-5a372c9a9e7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.477436 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.477403 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:39.645365 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.645340 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl"] Jun 05 15:42:39.647759 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:42:39.647719 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfb826f_576a_4acb_93f2_5a372c9a9e7d.slice/crio-f80352d76bd1f1d3306b39f2cf456dc2d37ba6ce9f30889c11c642d335f17196 WatchSource:0}: Error finding container f80352d76bd1f1d3306b39f2cf456dc2d37ba6ce9f30889c11c642d335f17196: Status 404 returned error can't find the container with id f80352d76bd1f1d3306b39f2cf456dc2d37ba6ce9f30889c11c642d335f17196 Jun 05 15:42:39.748485 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.748452 2572 generic.go:356] "Generic (PLEG): container finished" podID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" containerID="5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a" exitCode=0 Jun 05 15:42:39.748931 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.748523 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jlmd" Jun 05 15:42:39.748931 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.748555 2572 scope.go:117] "RemoveContainer" containerID="5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a" Jun 05 15:42:39.750176 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.750152 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" event={"ID":"1dfb826f-576a-4acb-93f2-5a372c9a9e7d","Type":"ContainerStarted","Data":"f80352d76bd1f1d3306b39f2cf456dc2d37ba6ce9f30889c11c642d335f17196"} Jun 05 15:42:39.751931 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.751892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" event={"ID":"6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6","Type":"ContainerStarted","Data":"243b7d58db69fe518db89c45ae860c180f4cc1c8fb77dbbcc043a28c4c169485"} Jun 05 15:42:39.752031 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.751942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" event={"ID":"6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6","Type":"ContainerStarted","Data":"8f6e4f984125eef2b6ee7612a65de5c9a86ddb490b23177b4dce8792a70eacd7"} Jun 05 15:42:39.752103 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.752025 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" Jun 05 15:42:39.767930 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.767913 2572 scope.go:117] "RemoveContainer" containerID="5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a" Jun 05 15:42:39.768187 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:42:39.768169 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a\": container with ID starting with 5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a not found: ID does not exist" containerID="5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a" Jun 05 15:42:39.768251 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.768194 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a"} err="failed to get container status \"5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a\": rpc error: code = NotFound desc = could not find container \"5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a\": container with ID starting with 5a725732650e66855cb71bd8dfa7d5f59aba3824e96885cb162a47bd51ec9f9a not found: ID does not exist" Jun 05 15:42:39.775216 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:39.775177 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" podStartSLOduration=1.7751645520000001 podStartE2EDuration="1.775164552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:42:39.773783561 +0000 UTC m=+629.182922128" watchObservedRunningTime="2026-06-05 15:42:39.775164552 +0000 UTC m=+629.184303120" Jun 05 15:42:41.093009 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:41.092977 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17d61fc0-20e5-4e38-bc73-4b3d5ac52802" path="/var/lib/kubelet/pods/17d61fc0-20e5-4e38-bc73-4b3d5ac52802/volumes" Jun 05 15:42:44.787586 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:44.787550 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" event={"ID":"1dfb826f-576a-4acb-93f2-5a372c9a9e7d","Type":"ContainerStarted","Data":"6d6a5211c7b8d130c601e149415afcdbe6ccaee45fac1e16a2fb5e6af297d6f3"} Jun 05 15:42:44.788028 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:44.787756 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:42:44.818311 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:44.818252 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" podStartSLOduration=1.633088752 podStartE2EDuration="5.818235087s" totalImagesPullingTime="4.185146335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:42:44.815563897 +0000 UTC m=+634.224702465" watchObservedRunningTime="2026-06-05 15:42:44.818235087 +0000 UTC m=+634.227373654" Jun 05 15:42:47.907528 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:47.907476 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f78d75b9b-5q79v" podUID="33138756-cd91-400c-b919-e2f54e318ce8" containerName="console" containerID="cri-o://3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87" gracePeriod=15 Jun 05 15:42:48.165082 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.165014 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:42:48.291864 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.291825 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-console-config\") pod \"33138756-cd91-400c-b919-e2f54e318ce8\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " Jun 05 15:42:48.291864 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.291870 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76pmk\" (UniqueName: \"kubernetes.io/projected/33138756-cd91-400c-b919-e2f54e318ce8-kube-api-access-76pmk\") pod \"33138756-cd91-400c-b919-e2f54e318ce8\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " Jun 05 15:42:48.292069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.291890 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-trusted-ca-bundle\") pod \"33138756-cd91-400c-b919-e2f54e318ce8\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " Jun 05 15:42:48.292069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.291911 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-serving-cert\") pod \"33138756-cd91-400c-b919-e2f54e318ce8\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " Jun 05 15:42:48.292069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.291980 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-oauth-serving-cert\") pod \"33138756-cd91-400c-b919-e2f54e318ce8\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " Jun 05 15:42:48.292069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292029 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-service-ca\") pod \"33138756-cd91-400c-b919-e2f54e318ce8\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " Jun 05 15:42:48.292069 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292053 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-oauth-config\") pod \"33138756-cd91-400c-b919-e2f54e318ce8\" (UID: \"33138756-cd91-400c-b919-e2f54e318ce8\") " Jun 05 15:42:48.292331 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292216 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-console-config" (OuterVolumeSpecName: "console-config") pod "33138756-cd91-400c-b919-e2f54e318ce8" (UID: "33138756-cd91-400c-b919-e2f54e318ce8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:42:48.292331 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292289 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "33138756-cd91-400c-b919-e2f54e318ce8" (UID: "33138756-cd91-400c-b919-e2f54e318ce8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:42:48.292445 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292344 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-trusted-ca-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:48.292445 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292356 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-console-config\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:48.292445 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292369 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "33138756-cd91-400c-b919-e2f54e318ce8" (UID: "33138756-cd91-400c-b919-e2f54e318ce8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:42:48.292564 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.292441 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-service-ca" (OuterVolumeSpecName: "service-ca") pod "33138756-cd91-400c-b919-e2f54e318ce8" (UID: "33138756-cd91-400c-b919-e2f54e318ce8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:42:48.294210 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.294178 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "33138756-cd91-400c-b919-e2f54e318ce8" (UID: "33138756-cd91-400c-b919-e2f54e318ce8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:42:48.294210 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.294191 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "33138756-cd91-400c-b919-e2f54e318ce8" (UID: "33138756-cd91-400c-b919-e2f54e318ce8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:42:48.294358 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.294251 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33138756-cd91-400c-b919-e2f54e318ce8-kube-api-access-76pmk" (OuterVolumeSpecName: "kube-api-access-76pmk") pod "33138756-cd91-400c-b919-e2f54e318ce8" (UID: "33138756-cd91-400c-b919-e2f54e318ce8"). InnerVolumeSpecName "kube-api-access-76pmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:42:48.393200 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.393161 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76pmk\" (UniqueName: \"kubernetes.io/projected/33138756-cd91-400c-b919-e2f54e318ce8-kube-api-access-76pmk\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:48.393200 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.393192 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-serving-cert\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:48.393200 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.393202 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-oauth-serving-cert\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:48.393455 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.393213 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33138756-cd91-400c-b919-e2f54e318ce8-service-ca\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:48.393455 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.393224 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33138756-cd91-400c-b919-e2f54e318ce8-console-oauth-config\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:42:48.812872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.812834 2572 generic.go:356] "Generic (PLEG): container finished" podID="33138756-cd91-400c-b919-e2f54e318ce8" containerID="3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87" exitCode=0 Jun 05 15:42:48.812872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.812871 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f78d75b9b-5q79v" Jun 05 15:42:48.813100 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.812905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f78d75b9b-5q79v" event={"ID":"33138756-cd91-400c-b919-e2f54e318ce8","Type":"ContainerDied","Data":"3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87"} Jun 05 15:42:48.813100 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.812958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f78d75b9b-5q79v" event={"ID":"33138756-cd91-400c-b919-e2f54e318ce8","Type":"ContainerDied","Data":"f63a551e8ef942e8eb9960f313a0c656e33ce053e0d500b1498eac32f19cedf6"} Jun 05 15:42:48.813100 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.812981 2572 scope.go:117] "RemoveContainer" containerID="3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87" Jun 05 15:42:48.822600 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.822584 2572 scope.go:117] "RemoveContainer" containerID="3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87" Jun 05 15:42:48.822866 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:42:48.822847 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87\": container with ID starting with 3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87 not found: ID does not exist" containerID="3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87" Jun 05 15:42:48.822943 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.822876 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87"} err="failed to get container status \"3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87\": rpc error: code = NotFound desc = could not find container \"3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87\": container with ID starting with 3675ddacdddfe188307045855642708003e75a85ba649f361df9f10d5b41cf87 not found: ID does not exist" Jun 05 15:42:48.835268 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.835245 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f78d75b9b-5q79v"] Jun 05 15:42:48.841970 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:48.841948 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f78d75b9b-5q79v"] Jun 05 15:42:49.098246 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:49.098155 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33138756-cd91-400c-b919-e2f54e318ce8" path="/var/lib/kubelet/pods/33138756-cd91-400c-b919-e2f54e318ce8/volumes" Jun 05 15:42:50.762436 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:50.762402 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7m8h4" Jun 05 15:42:55.795942 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:42:55.795905 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6h5tl" Jun 05 15:43:45.828161 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.828124 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6"] Jun 05 15:43:45.828701 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.828561 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33138756-cd91-400c-b919-e2f54e318ce8" containerName="console" Jun 05 15:43:45.828701 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.828576 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="33138756-cd91-400c-b919-e2f54e318ce8" containerName="console" Jun 05 15:43:45.828701 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.828661 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="33138756-cd91-400c-b919-e2f54e318ce8" containerName="console" Jun 05 15:43:45.832159 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.832141 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:45.834999 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.834980 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:43:45.835245 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.835227 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:43:45.835294 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.835276 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pvz2p\"" Jun 05 15:43:45.843130 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:45.843109 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6"] Jun 05 15:43:46.016530 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.016496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.016765 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.016563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b6lf\" (UniqueName: \"kubernetes.io/projected/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-kube-api-access-7b6lf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.016765 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.016700 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.117199 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.117158 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b6lf\" (UniqueName: \"kubernetes.io/projected/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-kube-api-access-7b6lf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.117414 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.117228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.117414 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.117263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.117621 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.117604 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.117735 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.117684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.127544 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.127515 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b6lf\" (UniqueName: \"kubernetes.io/projected/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-kube-api-access-7b6lf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.142233 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.142204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:46.280265 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:46.280228 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6"] Jun 05 15:43:46.281520 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:43:46.281496 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9987ad5d_8ab5_4a92_938a_1f13fce7c10f.slice/crio-6f75e646ce54743a1d442eecab0e6f9f23013d4cc6439f95815adba1bd730318 WatchSource:0}: Error finding container 6f75e646ce54743a1d442eecab0e6f9f23013d4cc6439f95815adba1bd730318: Status 404 returned error can't find the container with id 6f75e646ce54743a1d442eecab0e6f9f23013d4cc6439f95815adba1bd730318 Jun 05 15:43:47.157211 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:47.157181 2572 generic.go:356] "Generic (PLEG): container finished" podID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerID="ba2d5efd4260bdcba1a0c64016804d52af1b60085a8090d94a2f2d626991f59d" exitCode=0 Jun 05 15:43:47.157576 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:47.157271 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" event={"ID":"9987ad5d-8ab5-4a92-938a-1f13fce7c10f","Type":"ContainerDied","Data":"ba2d5efd4260bdcba1a0c64016804d52af1b60085a8090d94a2f2d626991f59d"} Jun 05 15:43:47.157576 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:47.157325 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" event={"ID":"9987ad5d-8ab5-4a92-938a-1f13fce7c10f","Type":"ContainerStarted","Data":"6f75e646ce54743a1d442eecab0e6f9f23013d4cc6439f95815adba1bd730318"} Jun 05 15:43:47.158311 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:47.158295 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:43:48.171757 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:48.171718 2572 generic.go:356] "Generic (PLEG): container finished" podID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerID="23fc7eb612a03ed5ce96767da13012a725c4f862b47839426fb898f9a29ea677" exitCode=0 Jun 05 15:43:48.172156 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:48.171802 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" event={"ID":"9987ad5d-8ab5-4a92-938a-1f13fce7c10f","Type":"ContainerDied","Data":"23fc7eb612a03ed5ce96767da13012a725c4f862b47839426fb898f9a29ea677"} Jun 05 15:43:49.183060 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:49.183021 2572 generic.go:356] "Generic (PLEG): container finished" podID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerID="f0e0df043c7349e02844160b6600b1b027ce1114daffad4ee91a8ad8d508d16f" exitCode=0 Jun 05 15:43:49.183440 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:49.183097 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" event={"ID":"9987ad5d-8ab5-4a92-938a-1f13fce7c10f","Type":"ContainerDied","Data":"f0e0df043c7349e02844160b6600b1b027ce1114daffad4ee91a8ad8d508d16f"} Jun 05 15:43:50.323745 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.323718 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:50.458587 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.458495 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-bundle\") pod \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " Jun 05 15:43:50.458587 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.458546 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b6lf\" (UniqueName: \"kubernetes.io/projected/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-kube-api-access-7b6lf\") pod \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " Jun 05 15:43:50.458859 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.458700 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-util\") pod \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\" (UID: \"9987ad5d-8ab5-4a92-938a-1f13fce7c10f\") " Jun 05 15:43:50.459202 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.459170 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-bundle" (OuterVolumeSpecName: "bundle") pod "9987ad5d-8ab5-4a92-938a-1f13fce7c10f" (UID: "9987ad5d-8ab5-4a92-938a-1f13fce7c10f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:43:50.460610 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.460588 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-kube-api-access-7b6lf" (OuterVolumeSpecName: "kube-api-access-7b6lf") pod "9987ad5d-8ab5-4a92-938a-1f13fce7c10f" (UID: "9987ad5d-8ab5-4a92-938a-1f13fce7c10f"). InnerVolumeSpecName "kube-api-access-7b6lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:43:50.464120 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.464095 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-util" (OuterVolumeSpecName: "util") pod "9987ad5d-8ab5-4a92-938a-1f13fce7c10f" (UID: "9987ad5d-8ab5-4a92-938a-1f13fce7c10f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:43:50.559425 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.559388 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b6lf\" (UniqueName: \"kubernetes.io/projected/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-kube-api-access-7b6lf\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:43:50.559425 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.559419 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-util\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:43:50.559425 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:50.559429 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9987ad5d-8ab5-4a92-938a-1f13fce7c10f-bundle\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:43:51.195891 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:51.195860 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" Jun 05 15:43:51.196066 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:51.195864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702knp6" event={"ID":"9987ad5d-8ab5-4a92-938a-1f13fce7c10f","Type":"ContainerDied","Data":"6f75e646ce54743a1d442eecab0e6f9f23013d4cc6439f95815adba1bd730318"} Jun 05 15:43:51.196066 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:43:51.195968 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f75e646ce54743a1d442eecab0e6f9f23013d4cc6439f95815adba1bd730318" Jun 05 15:44:09.098860 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.098782 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:44:09.099224 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.099207 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerName="pull" Jun 05 15:44:09.099286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.099227 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerName="pull" Jun 05 15:44:09.099286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.099246 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerName="util" Jun 05 15:44:09.099286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.099252 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerName="util" Jun 05 15:44:09.099286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.099260 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerName="extract" Jun 05 15:44:09.099286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.099265 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerName="extract" Jun 05 15:44:09.099441 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.099323 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9987ad5d-8ab5-4a92-938a-1f13fce7c10f" containerName="extract" Jun 05 15:44:09.102774 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.102757 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:09.105394 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.105367 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 15:44:09.105508 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.105412 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 15:44:09.105508 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.105448 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-grq68\"" Jun 05 15:44:09.106401 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.106387 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 15:44:09.113494 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.113469 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:44:09.211798 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.211758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bdft\" (UniqueName: \"kubernetes.io/projected/eec080a1-a9fb-46ae-a30d-4e8acde842e3-kube-api-access-2bdft\") pod \"maas-keycloak-0\" (UID: \"eec080a1-a9fb-46ae-a30d-4e8acde842e3\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:09.313283 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.313246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bdft\" (UniqueName: \"kubernetes.io/projected/eec080a1-a9fb-46ae-a30d-4e8acde842e3-kube-api-access-2bdft\") pod \"maas-keycloak-0\" (UID: \"eec080a1-a9fb-46ae-a30d-4e8acde842e3\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:09.323174 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.323138 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bdft\" (UniqueName: \"kubernetes.io/projected/eec080a1-a9fb-46ae-a30d-4e8acde842e3-kube-api-access-2bdft\") pod \"maas-keycloak-0\" (UID: \"eec080a1-a9fb-46ae-a30d-4e8acde842e3\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:09.413740 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.413704 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:09.557032 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:09.557006 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:44:09.558573 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:44:09.558546 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec080a1_a9fb_46ae_a30d_4e8acde842e3.slice/crio-1329a13a3018433f0deebea3689889693872daf7e2596922a84007f999f2b05a WatchSource:0}: Error finding container 1329a13a3018433f0deebea3689889693872daf7e2596922a84007f999f2b05a: Status 404 returned error can't find the container with id 1329a13a3018433f0deebea3689889693872daf7e2596922a84007f999f2b05a Jun 05 15:44:10.307494 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:10.307458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eec080a1-a9fb-46ae-a30d-4e8acde842e3","Type":"ContainerStarted","Data":"1329a13a3018433f0deebea3689889693872daf7e2596922a84007f999f2b05a"} Jun 05 15:44:15.149890 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:15.149865 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 15:44:15.349155 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:15.349106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eec080a1-a9fb-46ae-a30d-4e8acde842e3","Type":"ContainerStarted","Data":"e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1"} Jun 05 15:44:15.373140 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:15.373089 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.785933928 podStartE2EDuration="6.373072297s" totalImagesPullingTime="5.587138369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:44:15.36982552 +0000 UTC m=+724.778964090" watchObservedRunningTime="2026-06-05 15:44:15.373072297 +0000 UTC m=+724.782210879" Jun 05 15:44:15.414677 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:15.414547 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:15.416777 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:15.416738 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:16.414403 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:16.414351 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:17.415020 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:17.414963 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:18.414393 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:18.414329 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:19.414324 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:19.414278 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:19.415398 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:19.414667 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:20.414488 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:20.414441 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:21.414615 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:21.414566 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:22.414918 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:22.414874 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:23.415019 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:23.414969 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:24.414823 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:24.414765 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:25.414189 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:25.414136 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:26.414511 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:26.414463 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:27.414318 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:27.414279 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 15:44:28.546092 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:28.546036 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 15:44:28.565712 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:28.565659 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:44:38.552141 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:44:38.552109 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:19.915663 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:19.915612 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-rzr5v"] Jun 05 15:45:19.918124 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:19.918106 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" Jun 05 15:45:19.921710 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:19.921680 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vk89q\"" Jun 05 15:45:19.921868 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:19.921853 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 15:45:19.937562 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:19.937535 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-rzr5v"] Jun 05 15:45:20.066836 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:20.066801 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bsx9\" (UniqueName: \"kubernetes.io/projected/ff92c123-a23d-429e-aa04-1f42da5c330e-kube-api-access-6bsx9\") pod \"payload-processing-7c6c859784-rzr5v\" (UID: \"ff92c123-a23d-429e-aa04-1f42da5c330e\") " pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" Jun 05 15:45:20.168349 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:20.168263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bsx9\" (UniqueName: \"kubernetes.io/projected/ff92c123-a23d-429e-aa04-1f42da5c330e-kube-api-access-6bsx9\") pod \"payload-processing-7c6c859784-rzr5v\" (UID: \"ff92c123-a23d-429e-aa04-1f42da5c330e\") " pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" Jun 05 15:45:20.176869 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:20.176840 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bsx9\" (UniqueName: \"kubernetes.io/projected/ff92c123-a23d-429e-aa04-1f42da5c330e-kube-api-access-6bsx9\") pod \"payload-processing-7c6c859784-rzr5v\" (UID: \"ff92c123-a23d-429e-aa04-1f42da5c330e\") " pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" Jun 05 15:45:20.228786 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:20.228758 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" Jun 05 15:45:20.365180 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:20.365143 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-rzr5v"] Jun 05 15:45:20.366558 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:45:20.366533 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff92c123_a23d_429e_aa04_1f42da5c330e.slice/crio-6a5232731b5502fc6667792aa291c02795708ca6073691f553472427cc00bc82 WatchSource:0}: Error finding container 6a5232731b5502fc6667792aa291c02795708ca6073691f553472427cc00bc82: Status 404 returned error can't find the container with id 6a5232731b5502fc6667792aa291c02795708ca6073691f553472427cc00bc82 Jun 05 15:45:20.779707 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:20.779664 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" event={"ID":"ff92c123-a23d-429e-aa04-1f42da5c330e","Type":"ContainerStarted","Data":"6a5232731b5502fc6667792aa291c02795708ca6073691f553472427cc00bc82"} Jun 05 15:45:22.793740 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:22.793653 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" event={"ID":"ff92c123-a23d-429e-aa04-1f42da5c330e","Type":"ContainerStarted","Data":"0bba95964aaaa2b5b45cb421fd306e6a99af1739026d912a2bf2afb63875f6f2"} Jun 05 15:45:22.794111 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:22.793843 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" Jun 05 15:45:22.814002 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:22.813944 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" podStartSLOduration=1.801251862 podStartE2EDuration="3.813928945s" totalImagesPullingTime="2.012677083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:22.81199059 +0000 UTC m=+792.221129159" watchObservedRunningTime="2026-06-05 15:45:22.813928945 +0000 UTC m=+792.223067513" Jun 05 15:45:29.528700 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:29.528663 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:45:29.529129 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:29.528851 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" containerID="cri-o://e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1" gracePeriod=30 Jun 05 15:45:31.575240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.575213 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:31.671219 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.671188 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bdft\" (UniqueName: \"kubernetes.io/projected/eec080a1-a9fb-46ae-a30d-4e8acde842e3-kube-api-access-2bdft\") pod \"eec080a1-a9fb-46ae-a30d-4e8acde842e3\" (UID: \"eec080a1-a9fb-46ae-a30d-4e8acde842e3\") " Jun 05 15:45:31.673244 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.673215 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec080a1-a9fb-46ae-a30d-4e8acde842e3-kube-api-access-2bdft" (OuterVolumeSpecName: "kube-api-access-2bdft") pod "eec080a1-a9fb-46ae-a30d-4e8acde842e3" (UID: "eec080a1-a9fb-46ae-a30d-4e8acde842e3"). InnerVolumeSpecName "kube-api-access-2bdft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:45:31.772655 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.772548 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bdft\" (UniqueName: \"kubernetes.io/projected/eec080a1-a9fb-46ae-a30d-4e8acde842e3-kube-api-access-2bdft\") on node \"ip-10-0-140-178.ec2.internal\" DevicePath \"\"" Jun 05 15:45:31.848488 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.848455 2572 generic.go:356] "Generic (PLEG): container finished" podID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerID="e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1" exitCode=143 Jun 05 15:45:31.848678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.848499 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:31.848678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.848544 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eec080a1-a9fb-46ae-a30d-4e8acde842e3","Type":"ContainerDied","Data":"e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1"} Jun 05 15:45:31.848678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.848599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eec080a1-a9fb-46ae-a30d-4e8acde842e3","Type":"ContainerDied","Data":"1329a13a3018433f0deebea3689889693872daf7e2596922a84007f999f2b05a"} Jun 05 15:45:31.848678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.848620 2572 scope.go:117] "RemoveContainer" containerID="e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1" Jun 05 15:45:31.862434 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.862407 2572 scope.go:117] "RemoveContainer" containerID="e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1" Jun 05 15:45:31.862726 ip-10-0-140-178 kubenswrapper[2572]: E0605 15:45:31.862705 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1\": container with ID starting with e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1 not found: ID does not exist" containerID="e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1" Jun 05 15:45:31.862792 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.862739 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1"} err="failed to get container status \"e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1\": rpc error: code = NotFound desc = could not find container \"e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1\": container with ID starting with e23b872427e32863ae2f56f494f67e432b6d0735074362852e3d14b3a14d81b1 not found: ID does not exist" Jun 05 15:45:31.873586 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.873560 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:45:31.878158 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.878134 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:45:31.904037 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.904013 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:45:31.904429 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.904416 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" Jun 05 15:45:31.904483 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.904430 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" Jun 05 15:45:31.904518 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.904506 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" containerName="keycloak" Jun 05 15:45:31.906775 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.906755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:31.909570 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.909550 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 15:45:31.909719 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.909605 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 15:45:31.909719 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.909605 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-grq68\"" Jun 05 15:45:31.909850 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.909674 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 15:45:31.909850 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.909676 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 15:45:31.919258 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.919237 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:45:31.973808 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.973768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5n4m\" (UniqueName: \"kubernetes.io/projected/9e8b61e6-3578-49c8-bbee-a5d1f076d8ee-kube-api-access-b5n4m\") pod \"maas-keycloak-0\" (UID: \"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:31.974019 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:31.973884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9e8b61e6-3578-49c8-bbee-a5d1f076d8ee-test-realms\") pod \"maas-keycloak-0\" (UID: \"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:32.080835 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.075177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9e8b61e6-3578-49c8-bbee-a5d1f076d8ee-test-realms\") pod \"maas-keycloak-0\" (UID: \"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:32.080835 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.075284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5n4m\" (UniqueName: \"kubernetes.io/projected/9e8b61e6-3578-49c8-bbee-a5d1f076d8ee-kube-api-access-b5n4m\") pod \"maas-keycloak-0\" (UID: \"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:32.081781 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.081757 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9e8b61e6-3578-49c8-bbee-a5d1f076d8ee-test-realms\") pod \"maas-keycloak-0\" (UID: \"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:32.085217 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.085190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5n4m\" (UniqueName: \"kubernetes.io/projected/9e8b61e6-3578-49c8-bbee-a5d1f076d8ee-kube-api-access-b5n4m\") pod \"maas-keycloak-0\" (UID: \"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:32.217210 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.217169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:32.353015 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.352988 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:45:32.353539 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:45:32.353521 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8b61e6_3578_49c8_bbee_a5d1f076d8ee.slice/crio-a42f674f17d9a42fbab3d796dd5d466e680e1977e690b9d598b2725d2b80eb57 WatchSource:0}: Error finding container a42f674f17d9a42fbab3d796dd5d466e680e1977e690b9d598b2725d2b80eb57: Status 404 returned error can't find the container with id a42f674f17d9a42fbab3d796dd5d466e680e1977e690b9d598b2725d2b80eb57 Jun 05 15:45:32.858722 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.858615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee","Type":"ContainerStarted","Data":"8ecfc9727f4d6dd8878d5eefe718227ec5cac67aefedf6be815e487e55528b7a"} Jun 05 15:45:32.859168 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.858739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9e8b61e6-3578-49c8-bbee-a5d1f076d8ee","Type":"ContainerStarted","Data":"a42f674f17d9a42fbab3d796dd5d466e680e1977e690b9d598b2725d2b80eb57"} Jun 05 15:45:32.878255 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:32.878205 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.50075718 podStartE2EDuration="1.878188063s" totalImagesPullingTime="377.430883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:32.877476575 +0000 UTC m=+802.286615146" watchObservedRunningTime="2026-06-05 15:45:32.878188063 +0000 UTC m=+802.287326631" Jun 05 15:45:33.092129 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:33.092050 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec080a1-a9fb-46ae-a30d-4e8acde842e3" path="/var/lib/kubelet/pods/eec080a1-a9fb-46ae-a30d-4e8acde842e3/volumes" Jun 05 15:45:33.217613 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:33.217574 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:33.219370 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:33.219337 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:33.802748 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:33.802710 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-rzr5v" Jun 05 15:45:34.218465 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:34.218416 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:35.218715 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:35.218666 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:36.218125 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:36.218060 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:37.218493 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:37.218426 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:38.217744 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:38.217692 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:39.218693 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:39.218611 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:40.218767 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:40.218715 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:41.217795 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:41.217747 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:42.217545 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:42.217492 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:42.218219 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:42.218178 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:43.218057 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:43.218002 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:44.218199 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:44.218151 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:45.218297 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:45.218256 2572 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 05 15:45:46.349254 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:46.349213 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 15:45:46.369099 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:46.369030 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9e8b61e6-3578-49c8-bbee-a5d1f076d8ee" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:45:56.355536 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:45:56.355502 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 15:46:27.275582 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.275546 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k"] Jun 05 15:46:27.279856 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.279832 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.285871 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.285849 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 15:46:27.286112 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.285849 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fr2lc\"" Jun 05 15:46:27.286237 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.285849 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 15:46:27.286296 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.285851 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 15:46:27.290104 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.290081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ccaf39c-586f-4f1e-a200-5c545a62bd94-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.290206 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.290141 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.290312 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.290229 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.290312 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.290298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.290414 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.290387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k95vg\" (UniqueName: \"kubernetes.io/projected/4ccaf39c-586f-4f1e-a200-5c545a62bd94-kube-api-access-k95vg\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.290472 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.290411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.302255 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.302226 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k"] Jun 05 15:46:27.391610 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.391576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ccaf39c-586f-4f1e-a200-5c545a62bd94-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.391837 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.391646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.391837 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.391689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.391837 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.391748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.391837 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.391796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vg\" (UniqueName: \"kubernetes.io/projected/4ccaf39c-586f-4f1e-a200-5c545a62bd94-kube-api-access-k95vg\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.391837 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.391813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.392175 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.392151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.392237 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.392153 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.392237 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.392207 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.393958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.393939 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ccaf39c-586f-4f1e-a200-5c545a62bd94-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.394231 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.394214 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ccaf39c-586f-4f1e-a200-5c545a62bd94-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.406505 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.406477 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k95vg\" (UniqueName: \"kubernetes.io/projected/4ccaf39c-586f-4f1e-a200-5c545a62bd94-kube-api-access-k95vg\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k\" (UID: \"4ccaf39c-586f-4f1e-a200-5c545a62bd94\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.591059 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.590971 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:27.744002 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:27.743968 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k"] Jun 05 15:46:27.745834 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:46:27.745809 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccaf39c_586f_4f1e_a200_5c545a62bd94.slice/crio-8840d353ee1cbdacab1b0b5465025de3da298e121d578a0753bf3355ec7ff85c WatchSource:0}: Error finding container 8840d353ee1cbdacab1b0b5465025de3da298e121d578a0753bf3355ec7ff85c: Status 404 returned error can't find the container with id 8840d353ee1cbdacab1b0b5465025de3da298e121d578a0753bf3355ec7ff85c Jun 05 15:46:28.260477 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:28.260444 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" event={"ID":"4ccaf39c-586f-4f1e-a200-5c545a62bd94","Type":"ContainerStarted","Data":"8840d353ee1cbdacab1b0b5465025de3da298e121d578a0753bf3355ec7ff85c"} Jun 05 15:46:31.283849 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:31.283804 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" event={"ID":"4ccaf39c-586f-4f1e-a200-5c545a62bd94","Type":"ContainerStarted","Data":"64d933b6068fb3443cbce573c2bc54aecb4dbb67ceceeeecae06907ad096dea5"} Jun 05 15:46:33.304246 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:33.304211 2572 generic.go:356] "Generic (PLEG): container finished" podID="4ccaf39c-586f-4f1e-a200-5c545a62bd94" containerID="64d933b6068fb3443cbce573c2bc54aecb4dbb67ceceeeecae06907ad096dea5" exitCode=0 Jun 05 15:46:33.304678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:33.304281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" event={"ID":"4ccaf39c-586f-4f1e-a200-5c545a62bd94","Type":"ContainerDied","Data":"64d933b6068fb3443cbce573c2bc54aecb4dbb67ceceeeecae06907ad096dea5"} Jun 05 15:46:35.321103 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:35.321066 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" event={"ID":"4ccaf39c-586f-4f1e-a200-5c545a62bd94","Type":"ContainerStarted","Data":"12330452bdc00975ca60623e32b26874016efabbd1288142ab9647983e8fc33b"} Jun 05 15:46:37.591995 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:37.591963 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:37.592374 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:37.592016 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:37.604365 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:37.604339 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:37.626098 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:37.626047 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" podStartSLOduration=4.801095655 podStartE2EDuration="10.626028942s" totalImagesPullingTime="4.491595422s" totalInitContainerRuntime="1.333337865s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:46:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:46:35.344515953 +0000 UTC m=+864.753654517" watchObservedRunningTime="2026-06-05 15:46:37.626028942 +0000 UTC m=+867.035167509" Jun 05 15:46:38.352405 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:38.352377 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k" Jun 05 15:46:55.500143 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.500060 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk"] Jun 05 15:46:55.524551 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.524511 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk"] Jun 05 15:46:55.524749 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.524620 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.527851 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.527829 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 05 15:46:55.647901 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.647863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.648091 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.647929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.648091 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.648019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.648091 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.648062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.648091 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.648086 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwdt5\" (UniqueName: \"kubernetes.io/projected/de228406-96cf-45bc-9f80-d1390ba300d1-kube-api-access-dwdt5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.648247 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.648154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de228406-96cf-45bc-9f80-d1390ba300d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749087 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de228406-96cf-45bc-9f80-d1390ba300d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749087 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749319 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749124 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749319 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749367 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwdt5\" (UniqueName: \"kubernetes.io/projected/de228406-96cf-45bc-9f80-d1390ba300d1-kube-api-access-dwdt5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749575 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749555 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749702 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749677 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.749829 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.749733 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.751390 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.751338 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de228406-96cf-45bc-9f80-d1390ba300d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.751742 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.751724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de228406-96cf-45bc-9f80-d1390ba300d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.759191 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.759170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwdt5\" (UniqueName: \"kubernetes.io/projected/de228406-96cf-45bc-9f80-d1390ba300d1-kube-api-access-dwdt5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk\" (UID: \"de228406-96cf-45bc-9f80-d1390ba300d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.838182 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.838144 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:46:55.999762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:55.999738 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk"] Jun 05 15:46:56.002374 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:46:56.002317 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde228406_96cf_45bc_9f80_d1390ba300d1.slice/crio-e95d5d71e6ecf94ad3719ba4e36101095bcae7af8b4ae151373ad4313c2aedc4 WatchSource:0}: Error finding container e95d5d71e6ecf94ad3719ba4e36101095bcae7af8b4ae151373ad4313c2aedc4: Status 404 returned error can't find the container with id e95d5d71e6ecf94ad3719ba4e36101095bcae7af8b4ae151373ad4313c2aedc4 Jun 05 15:46:56.450439 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:56.450393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" event={"ID":"de228406-96cf-45bc-9f80-d1390ba300d1","Type":"ContainerStarted","Data":"2b53bdb76062281649d9f88d7030b1bf2d85b8e9b0e5e58376e12b11f568017d"} Jun 05 15:46:56.450610 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:56.450455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" event={"ID":"de228406-96cf-45bc-9f80-d1390ba300d1","Type":"ContainerStarted","Data":"e95d5d71e6ecf94ad3719ba4e36101095bcae7af8b4ae151373ad4313c2aedc4"} Jun 05 15:46:58.464788 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:58.464751 2572 generic.go:356] "Generic (PLEG): container finished" podID="de228406-96cf-45bc-9f80-d1390ba300d1" containerID="2b53bdb76062281649d9f88d7030b1bf2d85b8e9b0e5e58376e12b11f568017d" exitCode=0 Jun 05 15:46:58.465199 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:58.464825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" event={"ID":"de228406-96cf-45bc-9f80-d1390ba300d1","Type":"ContainerDied","Data":"2b53bdb76062281649d9f88d7030b1bf2d85b8e9b0e5e58376e12b11f568017d"} Jun 05 15:46:59.473615 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:59.473585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" event={"ID":"de228406-96cf-45bc-9f80-d1390ba300d1","Type":"ContainerStarted","Data":"4389f5e02dc2092bfde9e9bb3859c7462873a3884e0dd6de46c0b8e95840b3a7"} Jun 05 15:46:59.504790 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:46:59.504742 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" podStartSLOduration=2.6821681440000003 podStartE2EDuration="4.504726385s" totalImagesPullingTime="252.920346ms" totalInitContainerRuntime="1.569637895s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:46:59.50445308 +0000 UTC m=+888.913591649" watchObservedRunningTime="2026-06-05 15:46:59.504726385 +0000 UTC m=+888.913864953" Jun 05 15:47:05.838485 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:05.838443 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:47:05.839142 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:05.838520 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:47:05.851328 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:05.851295 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:47:06.527996 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:06.527965 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk" Jun 05 15:47:07.099894 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.099857 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk"] Jun 05 15:47:07.104942 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.104920 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.107811 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.107786 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 15:47:07.115938 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.115906 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk"] Jun 05 15:47:07.256366 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.256315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx8t4\" (UniqueName: \"kubernetes.io/projected/dd0f1de0-9d1c-491e-add5-72d678d32770-kube-api-access-fx8t4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.256569 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.256393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.256569 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.256419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.256569 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.256442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f1de0-9d1c-491e-add5-72d678d32770-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.256569 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.256464 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.256569 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.256558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357359 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357359 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357359 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f1de0-9d1c-491e-add5-72d678d32770-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357359 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357688 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357688 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx8t4\" (UniqueName: \"kubernetes.io/projected/dd0f1de0-9d1c-491e-add5-72d678d32770-kube-api-access-fx8t4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357807 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357840 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.357872 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.357860 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.359760 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.359737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f1de0-9d1c-491e-add5-72d678d32770-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.359911 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.359893 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f1de0-9d1c-491e-add5-72d678d32770-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.373906 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.373869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx8t4\" (UniqueName: \"kubernetes.io/projected/dd0f1de0-9d1c-491e-add5-72d678d32770-kube-api-access-fx8t4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk\" (UID: \"dd0f1de0-9d1c-491e-add5-72d678d32770\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.416564 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.416526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:07.565120 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:07.565080 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk"] Jun 05 15:47:07.565844 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:47:07.565819 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0f1de0_9d1c_491e_add5_72d678d32770.slice/crio-7239586ab2bd05e78fc57aa3cda179d71e861e314dd64b401b272875b9ee5583 WatchSource:0}: Error finding container 7239586ab2bd05e78fc57aa3cda179d71e861e314dd64b401b272875b9ee5583: Status 404 returned error can't find the container with id 7239586ab2bd05e78fc57aa3cda179d71e861e314dd64b401b272875b9ee5583 Jun 05 15:47:08.532465 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:08.532432 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" event={"ID":"dd0f1de0-9d1c-491e-add5-72d678d32770","Type":"ContainerStarted","Data":"cfb0d24ee8d43836b287d18b746384b12d347ce8cb33a06411664973eee973a4"} Jun 05 15:47:08.532898 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:08.532482 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" event={"ID":"dd0f1de0-9d1c-491e-add5-72d678d32770","Type":"ContainerStarted","Data":"7239586ab2bd05e78fc57aa3cda179d71e861e314dd64b401b272875b9ee5583"} Jun 05 15:47:09.539798 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:09.539765 2572 generic.go:356] "Generic (PLEG): container finished" podID="dd0f1de0-9d1c-491e-add5-72d678d32770" containerID="cfb0d24ee8d43836b287d18b746384b12d347ce8cb33a06411664973eee973a4" exitCode=0 Jun 05 15:47:09.540277 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:09.539854 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" event={"ID":"dd0f1de0-9d1c-491e-add5-72d678d32770","Type":"ContainerDied","Data":"cfb0d24ee8d43836b287d18b746384b12d347ce8cb33a06411664973eee973a4"} Jun 05 15:47:10.547847 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:10.547811 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" event={"ID":"dd0f1de0-9d1c-491e-add5-72d678d32770","Type":"ContainerStarted","Data":"8c24816273c06ac3b07d4d1226f46a33ba58e9fee08e28f413303c8ddebae249"} Jun 05 15:47:10.574323 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:10.574274 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" podStartSLOduration=2.059351581 podStartE2EDuration="3.574260088s" totalImagesPullingTime="215.300606ms" totalInitContainerRuntime="1.299607901s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:47:10.572326079 +0000 UTC m=+899.981464646" watchObservedRunningTime="2026-06-05 15:47:10.574260088 +0000 UTC m=+899.983398655" Jun 05 15:47:11.123424 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:11.123391 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:47:11.124507 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:11.124485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:47:11.132011 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:11.131988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:47:11.132918 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:11.132895 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:47:14.816451 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.816415 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f"] Jun 05 15:47:14.822743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.822723 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.826112 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.826091 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 05 15:47:14.828317 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.828297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2md8\" (UniqueName: \"kubernetes.io/projected/94075927-94dd-44c6-9495-166d62cca870-kube-api-access-c2md8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.828317 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.828325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.828495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.828354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.828495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.828415 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94075927-94dd-44c6-9495-166d62cca870-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.828495 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.828477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.828676 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.828522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.846554 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.846532 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f"] Jun 05 15:47:14.929614 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.929581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.929793 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.929678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2md8\" (UniqueName: \"kubernetes.io/projected/94075927-94dd-44c6-9495-166d62cca870-kube-api-access-c2md8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.929793 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.929708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.929793 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.929740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.929793 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.929780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94075927-94dd-44c6-9495-166d62cca870-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.930108 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.930088 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.930207 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.930149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.930284 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.930223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.930414 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.930390 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.932123 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.932088 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94075927-94dd-44c6-9495-166d62cca870-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.932383 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.932362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94075927-94dd-44c6-9495-166d62cca870-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:14.943174 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:14.943141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2md8\" (UniqueName: \"kubernetes.io/projected/94075927-94dd-44c6-9495-166d62cca870-kube-api-access-c2md8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f\" (UID: \"94075927-94dd-44c6-9495-166d62cca870\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:15.133152 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:15.133119 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:47:15.280182 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:15.280149 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f"] Jun 05 15:47:15.280614 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:47:15.280592 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94075927_94dd_44c6_9495_166d62cca870.slice/crio-e83fcd9d97496125383cac2062f5acd5049c779b34afb166332c3baf042f735e WatchSource:0}: Error finding container e83fcd9d97496125383cac2062f5acd5049c779b34afb166332c3baf042f735e: Status 404 returned error can't find the container with id e83fcd9d97496125383cac2062f5acd5049c779b34afb166332c3baf042f735e Jun 05 15:47:15.580958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:15.580857 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" event={"ID":"94075927-94dd-44c6-9495-166d62cca870","Type":"ContainerStarted","Data":"94fc4b91d83928d0302604807dd5fee04c2a4b8bb9381b9bee3f3f0481da518d"} Jun 05 15:47:15.580958 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:15.580930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" event={"ID":"94075927-94dd-44c6-9495-166d62cca870","Type":"ContainerStarted","Data":"e83fcd9d97496125383cac2062f5acd5049c779b34afb166332c3baf042f735e"} Jun 05 15:47:17.417042 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:17.417006 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:17.417454 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:17.417063 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:17.429875 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:17.429850 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:17.605194 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:17.605166 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk" Jun 05 15:47:22.486052 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.486020 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw"] Jun 05 15:47:22.491489 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.491469 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.494422 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.494403 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 15:47:22.502820 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.502794 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw"] Jun 05 15:47:22.598803 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.598764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3644b0d2-2e0d-4b56-8e20-f0a90142d202-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.598937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.598814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.598937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.598846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgglm\" (UniqueName: \"kubernetes.io/projected/3644b0d2-2e0d-4b56-8e20-f0a90142d202-kube-api-access-hgglm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.598937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.598866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.598937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.598882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.599083 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.598935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.699438 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.699407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3644b0d2-2e0d-4b56-8e20-f0a90142d202-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.699573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.699454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.699573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.699478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgglm\" (UniqueName: \"kubernetes.io/projected/3644b0d2-2e0d-4b56-8e20-f0a90142d202-kube-api-access-hgglm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.699573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.699499 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.699573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.699517 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.699573 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.699547 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.699977 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.699956 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.700043 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.700002 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.700108 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.700081 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.701743 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.701714 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3644b0d2-2e0d-4b56-8e20-f0a90142d202-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.701992 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.701965 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3644b0d2-2e0d-4b56-8e20-f0a90142d202-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.708834 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.708812 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgglm\" (UniqueName: \"kubernetes.io/projected/3644b0d2-2e0d-4b56-8e20-f0a90142d202-kube-api-access-hgglm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r74lw\" (UID: \"3644b0d2-2e0d-4b56-8e20-f0a90142d202\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.801964 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.801880 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:47:22.943030 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:22.942997 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw"] Jun 05 15:47:22.944225 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:47:22.944200 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3644b0d2_2e0d_4b56_8e20_f0a90142d202.slice/crio-a4c866841b660095d6b8900dd3c1a0582fbd4063f7fa7893e03b52d0e19611eb WatchSource:0}: Error finding container a4c866841b660095d6b8900dd3c1a0582fbd4063f7fa7893e03b52d0e19611eb: Status 404 returned error can't find the container with id a4c866841b660095d6b8900dd3c1a0582fbd4063f7fa7893e03b52d0e19611eb Jun 05 15:47:23.637308 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:23.637273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" event={"ID":"3644b0d2-2e0d-4b56-8e20-f0a90142d202","Type":"ContainerStarted","Data":"1e4bcfd565e094b8af57517e580ca9fcc71a32a4650b3cebdd2efcf1f2f6af82"} Jun 05 15:47:23.637719 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:47:23.637318 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" event={"ID":"3644b0d2-2e0d-4b56-8e20-f0a90142d202","Type":"ContainerStarted","Data":"a4c866841b660095d6b8900dd3c1a0582fbd4063f7fa7893e03b52d0e19611eb"} Jun 05 15:48:15.955725 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:15.955616 2572 generic.go:356] "Generic (PLEG): container finished" podID="3644b0d2-2e0d-4b56-8e20-f0a90142d202" containerID="1e4bcfd565e094b8af57517e580ca9fcc71a32a4650b3cebdd2efcf1f2f6af82" exitCode=0 Jun 05 15:48:15.955725 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:15.955688 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" event={"ID":"3644b0d2-2e0d-4b56-8e20-f0a90142d202","Type":"ContainerDied","Data":"1e4bcfd565e094b8af57517e580ca9fcc71a32a4650b3cebdd2efcf1f2f6af82"} Jun 05 15:48:16.964414 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:16.964377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" event={"ID":"3644b0d2-2e0d-4b56-8e20-f0a90142d202","Type":"ContainerStarted","Data":"029fde14adcaf3c4398dbfc7d4a3129b63973d4cbcb10a71a8cc7a1a494efd39"} Jun 05 15:48:16.988519 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:16.988471 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" podStartSLOduration=2.081152173 podStartE2EDuration="54.988453508s" totalImagesPullingTime="239.494423ms" totalInitContainerRuntime="52.667806912s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:48:16.986151625 +0000 UTC m=+966.395290194" watchObservedRunningTime="2026-06-05 15:48:16.988453508 +0000 UTC m=+966.397592093" Jun 05 15:48:17.972286 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:17.972249 2572 generic.go:356] "Generic (PLEG): container finished" podID="94075927-94dd-44c6-9495-166d62cca870" containerID="94fc4b91d83928d0302604807dd5fee04c2a4b8bb9381b9bee3f3f0481da518d" exitCode=0 Jun 05 15:48:17.972704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:17.972322 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" event={"ID":"94075927-94dd-44c6-9495-166d62cca870","Type":"ContainerDied","Data":"94fc4b91d83928d0302604807dd5fee04c2a4b8bb9381b9bee3f3f0481da518d"} Jun 05 15:48:18.980337 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:18.980299 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" event={"ID":"94075927-94dd-44c6-9495-166d62cca870","Type":"ContainerStarted","Data":"e8a9e256838b60ab59ad2a0ed4c7fec43034ab14dfead6dd2cabc22ac9fbf29d"} Jun 05 15:48:19.001389 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:19.001340 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" podStartSLOduration=3.192495758 podStartE2EDuration="1m5.001324846s" totalImagesPullingTime="179.683476ms" totalInitContainerRuntime="1m1.629145612s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:48:19.000116531 +0000 UTC m=+968.409255144" watchObservedRunningTime="2026-06-05 15:48:19.001324846 +0000 UTC m=+968.410463413" Jun 05 15:48:22.802789 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:22.802756 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:48:22.802789 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:22.802798 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:48:22.815158 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:22.815135 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:48:23.014222 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:23.014194 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r74lw" Jun 05 15:48:25.133748 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:25.133676 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:48:25.134126 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:25.133924 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:48:25.145940 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:25.145910 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:48:26.033644 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:48:26.033605 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f" Jun 05 15:52:11.174871 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:11.174842 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:52:11.178696 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:11.178671 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:52:11.182439 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:11.182418 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:52:11.185704 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:11.185684 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmgwm_0f1f3ef0-5c7b-4407-9297-744b429a84c9/ovn-acl-logging/0.log" Jun 05 15:52:16.527287 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:16.527262 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b7b94fdc5-pzs8x_29f1803b-49f9-4121-8d55-45195cae420f/nginx/0.log" Jun 05 15:52:16.751465 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:16.751433 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-crgjt_ed89b0f0-bf4c-4867-b041-b486f77bff34/manager/0.log" Jun 05 15:52:16.864344 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:16.864309 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zntt4_8154223a-e19f-43bf-aed2-c885e7179cc6/manager/0.log" Jun 05 15:52:17.189752 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:17.189680 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-84wkt_7ad2380c-ea0e-42e7-9606-a97ecbe439f9/server/0.log" Jun 05 15:52:17.300242 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:17.300201 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hbzm4_a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8/manager/0.log" Jun 05 15:52:17.410492 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:17.410465 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f4b89576-9txl8_345ae7be-a715-4aa6-b260-1474fc08f114/copy-manifests/0.log" Jun 05 15:52:17.423345 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:17.423311 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f4b89576-9txl8_345ae7be-a715-4aa6-b260-1474fc08f114/manager/0.log" Jun 05 15:52:18.508240 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.508207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt_54843bb4-792b-4479-8a4c-c7ba7845cd93/util/0.log" Jun 05 15:52:18.514937 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.514914 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt_54843bb4-792b-4479-8a4c-c7ba7845cd93/pull/0.log" Jun 05 15:52:18.520765 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.520743 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt_54843bb4-792b-4479-8a4c-c7ba7845cd93/extract/0.log" Jun 05 15:52:18.626389 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.626362 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq_f3cec3fb-f935-4d01-b848-20eeacbb5197/util/0.log" Jun 05 15:52:18.632466 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.632444 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq_f3cec3fb-f935-4d01-b848-20eeacbb5197/pull/0.log" Jun 05 15:52:18.638797 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.638780 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq_f3cec3fb-f935-4d01-b848-20eeacbb5197/extract/0.log" Jun 05 15:52:18.748915 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.748887 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc_196b0481-f356-4b8a-8f7c-333bbf43ee13/util/0.log" Jun 05 15:52:18.755103 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.755080 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc_196b0481-f356-4b8a-8f7c-333bbf43ee13/pull/0.log" Jun 05 15:52:18.761442 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.761393 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc_196b0481-f356-4b8a-8f7c-333bbf43ee13/extract/0.log" Jun 05 15:52:18.875681 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.875653 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87_ace825e9-2895-43af-a2a3-0ff0790d715e/extract/0.log" Jun 05 15:52:18.882115 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.882093 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87_ace825e9-2895-43af-a2a3-0ff0790d715e/util/0.log" Jun 05 15:52:18.888762 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:18.888746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87_ace825e9-2895-43af-a2a3-0ff0790d715e/pull/0.log" Jun 05 15:52:19.595832 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:19.595805 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6h5tl_1dfb826f-576a-4acb-93f2-5a372c9a9e7d/manager/0.log" Jun 05 15:52:19.824175 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:19.824147 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7m8h4_6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6/manager/0.log" Jun 05 15:52:20.272784 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:20.272755 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2tmt_80f4b42a-22e7-42b5-a5a9-419031117648/discovery/0.log" Jun 05 15:52:20.481435 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:20.481406 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-656445bd89-qdbkx_37927820-27bc-4821-9c15-6aaffa9151c1/kube-auth-proxy/0.log" Jun 05 15:52:20.810680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:20.810621 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rzr5v_ff92c123-a23d-429e-aa04-1f42da5c330e/payload-processing/0.log" Jun 05 15:52:21.255806 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.255774 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k_4ccaf39c-586f-4f1e-a200-5c545a62bd94/storage-initializer/0.log" Jun 05 15:52:21.263560 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.263537 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jjb2k_4ccaf39c-586f-4f1e-a200-5c545a62bd94/main/0.log" Jun 05 15:52:21.478366 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.478339 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk_de228406-96cf-45bc-9f80-d1390ba300d1/storage-initializer/0.log" Jun 05 15:52:21.486035 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.486011 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-sknrk_de228406-96cf-45bc-9f80-d1390ba300d1/main/0.log" Jun 05 15:52:21.589427 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.589343 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk_dd0f1de0-9d1c-491e-add5-72d678d32770/storage-initializer/0.log" Jun 05 15:52:21.596803 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.596769 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chzksk_dd0f1de0-9d1c-491e-add5-72d678d32770/main/0.log" Jun 05 15:52:21.706654 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.706606 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f_94075927-94dd-44c6-9495-166d62cca870/storage-initializer/0.log" Jun 05 15:52:21.713748 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.713728 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-6ht2f_94075927-94dd-44c6-9495-166d62cca870/main/0.log" Jun 05 15:52:21.821351 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.821322 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-r74lw_3644b0d2-2e0d-4b56-8e20-f0a90142d202/storage-initializer/0.log" Jun 05 15:52:21.828313 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:21.828293 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-r74lw_3644b0d2-2e0d-4b56-8e20-f0a90142d202/main/0.log" Jun 05 15:52:28.639886 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:28.639858 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-blcwx_e052aaf8-33cd-421d-9173-1d49acbaef6e/global-pull-secret-syncer/0.log" Jun 05 15:52:28.864524 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:28.864485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-slwkp_e7ebcc5d-aa0a-4153-9dcb-929733f3398f/konnectivity-agent/0.log" Jun 05 15:52:28.954153 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:28.954085 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-178.ec2.internal_da0fa063dbe0100aefbaf62644f3598d/haproxy/0.log" Jun 05 15:52:32.041434 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:32.041400 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-tkv89_c0c9ef1e-8390-4aee-8944-555564c0e0f3/sail-operator/0.log" Jun 05 15:52:32.868831 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:32.868803 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt_54843bb4-792b-4479-8a4c-c7ba7845cd93/extract/0.log" Jun 05 15:52:32.899088 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:32.899054 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt_54843bb4-792b-4479-8a4c-c7ba7845cd93/util/0.log" Jun 05 15:52:32.922737 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:32.922704 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598w9nt_54843bb4-792b-4479-8a4c-c7ba7845cd93/pull/0.log" Jun 05 15:52:32.953108 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:32.953083 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq_f3cec3fb-f935-4d01-b848-20eeacbb5197/extract/0.log" Jun 05 15:52:32.986659 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:32.986616 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq_f3cec3fb-f935-4d01-b848-20eeacbb5197/util/0.log" Jun 05 15:52:33.013250 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.013221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cddq_f3cec3fb-f935-4d01-b848-20eeacbb5197/pull/0.log" Jun 05 15:52:33.055690 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.055650 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc_196b0481-f356-4b8a-8f7c-333bbf43ee13/extract/0.log" Jun 05 15:52:33.077791 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.077765 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc_196b0481-f356-4b8a-8f7c-333bbf43ee13/util/0.log" Jun 05 15:52:33.100285 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.100258 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738snsc_196b0481-f356-4b8a-8f7c-333bbf43ee13/pull/0.log" Jun 05 15:52:33.127709 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.127609 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87_ace825e9-2895-43af-a2a3-0ff0790d715e/extract/0.log" Jun 05 15:52:33.150591 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.150565 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87_ace825e9-2895-43af-a2a3-0ff0790d715e/util/0.log" Jun 05 15:52:33.173413 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.173387 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4f87_ace825e9-2895-43af-a2a3-0ff0790d715e/pull/0.log" Jun 05 15:52:33.395867 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.395779 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6h5tl_1dfb826f-576a-4acb-93f2-5a372c9a9e7d/manager/0.log" Jun 05 15:52:33.470716 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:33.470686 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7m8h4_6ed2accb-d8bf-4a4a-89dd-09fb2e7b67e6/manager/0.log" Jun 05 15:52:35.280791 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.280760 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc324e3-00da-4d2f-ad55-72e6812f5e45/alertmanager/0.log" Jun 05 15:52:35.304915 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.304887 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc324e3-00da-4d2f-ad55-72e6812f5e45/config-reloader/0.log" Jun 05 15:52:35.327219 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.327189 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc324e3-00da-4d2f-ad55-72e6812f5e45/kube-rbac-proxy-web/0.log" Jun 05 15:52:35.351576 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.351550 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc324e3-00da-4d2f-ad55-72e6812f5e45/kube-rbac-proxy/0.log" Jun 05 15:52:35.373246 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.373207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc324e3-00da-4d2f-ad55-72e6812f5e45/kube-rbac-proxy-metric/0.log" Jun 05 15:52:35.394703 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.394673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc324e3-00da-4d2f-ad55-72e6812f5e45/prom-label-proxy/0.log" Jun 05 15:52:35.417680 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.417651 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc324e3-00da-4d2f-ad55-72e6812f5e45/init-config-reloader/0.log" Jun 05 15:52:35.461911 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.461879 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-j76wp_0e4c5a07-6763-4bd6-af89-99e4aec8b2a7/cluster-monitoring-operator/0.log" Jun 05 15:52:35.487264 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.487233 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2kfdv_be3acbf6-a562-42f2-8527-575195e0fee7/kube-state-metrics/0.log" Jun 05 15:52:35.508435 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.508411 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2kfdv_be3acbf6-a562-42f2-8527-575195e0fee7/kube-rbac-proxy-main/0.log" Jun 05 15:52:35.528748 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.528724 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2kfdv_be3acbf6-a562-42f2-8527-575195e0fee7/kube-rbac-proxy-self/0.log" Jun 05 15:52:35.620767 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.620742 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5jfpr_0ddcebd9-0ef3-4352-a716-2d5335b6a71b/node-exporter/0.log" Jun 05 15:52:35.643741 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.643715 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5jfpr_0ddcebd9-0ef3-4352-a716-2d5335b6a71b/kube-rbac-proxy/0.log" Jun 05 15:52:35.665201 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:35.665179 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5jfpr_0ddcebd9-0ef3-4352-a716-2d5335b6a71b/init-textfile/0.log" Jun 05 15:52:36.209769 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:36.209743 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-8x4zg_af9c4e34-b1c0-4ac8-acd2-2b7e707941c0/prometheus-operator/0.log" Jun 05 15:52:36.237000 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:36.236978 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-8x4zg_af9c4e34-b1c0-4ac8-acd2-2b7e707941c0/kube-rbac-proxy/0.log" Jun 05 15:52:37.910247 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:37.910218 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-rl7x7_03cbd584-f698-47be-b8db-30a25820e978/networking-console-plugin/0.log" Jun 05 15:52:38.565255 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:38.565226 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/1.log" Jun 05 15:52:38.570483 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:38.570454 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-24b8p_5b976f8b-9cc9-47f9-97ae-ee538a7ea318/console-operator/2.log" Jun 05 15:52:39.476566 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.476532 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55"] Jun 05 15:52:39.480210 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.480192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.482319 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.482298 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xkqxr\"/\"default-dockercfg-xh72z\"" Jun 05 15:52:39.482559 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.482534 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkqxr\"/\"openshift-service-ca.crt\"" Jun 05 15:52:39.483409 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.483386 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkqxr\"/\"kube-root-ca.crt\"" Jun 05 15:52:39.491408 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.491382 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55"] Jun 05 15:52:39.606614 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.606582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-lib-modules\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.606821 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.606650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-proc\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.606821 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.606678 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-podres\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.606821 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.606703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh7pn\" (UniqueName: \"kubernetes.io/projected/58d1c537-dc97-479c-9627-c95af78c0851-kube-api-access-jh7pn\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.606821 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.606792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-sys\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707638 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-sys\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707697 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-sys\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-lib-modules\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-proc\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707812 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-podres\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707979 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh7pn\" (UniqueName: \"kubernetes.io/projected/58d1c537-dc97-479c-9627-c95af78c0851-kube-api-access-jh7pn\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707979 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-lib-modules\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707979 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707882 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-proc\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.707979 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.707941 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58d1c537-dc97-479c-9627-c95af78c0851-podres\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.715782 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.715761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh7pn\" (UniqueName: \"kubernetes.io/projected/58d1c537-dc97-479c-9627-c95af78c0851-kube-api-access-jh7pn\") pod \"perf-node-gather-daemonset-p8k55\" (UID: \"58d1c537-dc97-479c-9627-c95af78c0851\") " pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.792522 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.792441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:39.932652 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:39.932608 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55"] Jun 05 15:52:39.934714 ip-10-0-140-178 kubenswrapper[2572]: W0605 15:52:39.934683 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58d1c537_dc97_479c_9627_c95af78c0851.slice/crio-6a51f18847d5acc158c31cdbe931ecc60a3f4449a46ab784047282845cce89fe WatchSource:0}: Error finding container 6a51f18847d5acc158c31cdbe931ecc60a3f4449a46ab784047282845cce89fe: Status 404 returned error can't find the container with id 6a51f18847d5acc158c31cdbe931ecc60a3f4449a46ab784047282845cce89fe Jun 05 15:52:40.598277 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:40.598243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" event={"ID":"58d1c537-dc97-479c-9627-c95af78c0851","Type":"ContainerStarted","Data":"d3ca8a0bc76af26f72eccca7d748609957225f626d1d269ef686dfd47544e650"} Jun 05 15:52:40.599057 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:40.598294 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" event={"ID":"58d1c537-dc97-479c-9627-c95af78c0851","Type":"ContainerStarted","Data":"6a51f18847d5acc158c31cdbe931ecc60a3f4449a46ab784047282845cce89fe"} Jun 05 15:52:40.599057 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:40.598390 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:40.618879 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:40.618827 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" podStartSLOduration=1.618811913 podStartE2EDuration="1.618811913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:52:40.617233384 +0000 UTC m=+1230.026371964" watchObservedRunningTime="2026-06-05 15:52:40.618811913 +0000 UTC m=+1230.027950480" Jun 05 15:52:41.144199 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:41.144174 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lfdf2_de0874a1-c310-49ce-bfe0-067200199f9b/dns/0.log" Jun 05 15:52:41.165498 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:41.165474 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lfdf2_de0874a1-c310-49ce-bfe0-067200199f9b/kube-rbac-proxy/0.log" Jun 05 15:52:41.189257 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:41.189235 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wghj2_14f98abb-c0d9-454d-a858-daa8f53a564c/dns-node-resolver/0.log" Jun 05 15:52:41.795852 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:41.795821 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j7c54_f284b810-0863-4c87-b40b-d33dcaa92cb7/node-ca/0.log" Jun 05 15:52:42.832045 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:42.832014 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2tmt_80f4b42a-22e7-42b5-a5a9-419031117648/discovery/0.log" Jun 05 15:52:42.886354 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:42.886325 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-656445bd89-qdbkx_37927820-27bc-4821-9c15-6aaffa9151c1/kube-auth-proxy/0.log" Jun 05 15:52:42.968278 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:42.968251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rzr5v_ff92c123-a23d-429e-aa04-1f42da5c330e/payload-processing/0.log" Jun 05 15:52:43.612437 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:43.612405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtgzv_39a9c053-831e-4872-8741-77156dedbd94/serve-healthcheck-canary/0.log" Jun 05 15:52:44.187270 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:44.187234 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-8sr6g_2331941e-c023-4afb-b017-e1a3a796c555/insights-operator/1.log" Jun 05 15:52:44.192122 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:44.192103 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-8sr6g_2331941e-c023-4afb-b017-e1a3a796c555/insights-operator/0.log" Jun 05 15:52:44.368007 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:44.367986 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tmdlm_df71b1f0-d122-4d9e-a7d5-70f015b6555e/kube-rbac-proxy/0.log" Jun 05 15:52:44.390819 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:44.390797 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tmdlm_df71b1f0-d122-4d9e-a7d5-70f015b6555e/exporter/0.log" Jun 05 15:52:44.415418 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:44.415398 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tmdlm_df71b1f0-d122-4d9e-a7d5-70f015b6555e/extractor/0.log" Jun 05 15:52:46.614300 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:46.614273 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xkqxr/perf-node-gather-daemonset-p8k55" Jun 05 15:52:46.774678 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:46.774646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b7b94fdc5-pzs8x_29f1803b-49f9-4121-8d55-45195cae420f/nginx/0.log" Jun 05 15:52:46.836757 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:46.836734 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-crgjt_ed89b0f0-bf4c-4867-b041-b486f77bff34/manager/0.log" Jun 05 15:52:46.879913 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:46.879858 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zntt4_8154223a-e19f-43bf-aed2-c885e7179cc6/manager/0.log" Jun 05 15:52:46.958768 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:46.958749 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-84wkt_7ad2380c-ea0e-42e7-9606-a97ecbe439f9/server/0.log" Jun 05 15:52:47.003017 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:47.002996 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hbzm4_a0e2f2ad-c47d-4c9e-9a0e-6ebbee8c2dd8/manager/0.log" Jun 05 15:52:47.059094 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:47.059071 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f4b89576-9txl8_345ae7be-a715-4aa6-b260-1474fc08f114/manager/0.log" Jun 05 15:52:47.077425 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:47.077404 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f4b89576-9txl8_345ae7be-a715-4aa6-b260-1474fc08f114/copy-manifests/0.log" Jun 05 15:52:48.959266 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:48.959241 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-sxqnr_62142234-143b-493e-9b0d-f9970f212a0a/openshift-lws-operator/0.log" Jun 05 15:52:53.406525 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:53.406443 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2tmt_80f4b42a-22e7-42b5-a5a9-419031117648/discovery/0.log" Jun 05 15:52:53.436444 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:53.436419 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-656445bd89-qdbkx_37927820-27bc-4821-9c15-6aaffa9151c1/kube-auth-proxy/0.log" Jun 05 15:52:53.486211 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:53.486187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rzr5v_ff92c123-a23d-429e-aa04-1f42da5c330e/payload-processing/0.log" Jun 05 15:52:54.270256 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:54.270227 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kcgvj_d8de78cc-6301-4ecc-a4a8-086750c2fa3b/migrator/0.log" Jun 05 15:52:54.291131 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:54.291107 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kcgvj_d8de78cc-6301-4ecc-a4a8-086750c2fa3b/graceful-termination/0.log" Jun 05 15:52:54.596324 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:54.596230 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2tmt_80f4b42a-22e7-42b5-a5a9-419031117648/discovery/0.log" Jun 05 15:52:54.622954 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:54.622924 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-656445bd89-qdbkx_37927820-27bc-4821-9c15-6aaffa9151c1/kube-auth-proxy/0.log" Jun 05 15:52:54.674931 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:54.674902 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rzr5v_ff92c123-a23d-429e-aa04-1f42da5c330e/payload-processing/0.log" Jun 05 15:52:54.682665 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:54.682637 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mbm84_d5728d9b-d895-49e0-87d6-8b1863c2447f/kube-storage-version-migrator-operator/1.log" Jun 05 15:52:54.683485 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:54.683464 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mbm84_d5728d9b-d895-49e0-87d6-8b1863c2447f/kube-storage-version-migrator-operator/0.log" Jun 05 15:52:56.180650 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.180592 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nxhbx_82c72e62-83fb-4306-b430-5b8e7e0b07cf/kube-multus-additional-cni-plugins/0.log" Jun 05 15:52:56.203912 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.203878 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nxhbx_82c72e62-83fb-4306-b430-5b8e7e0b07cf/egress-router-binary-copy/0.log" Jun 05 15:52:56.230552 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.230527 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nxhbx_82c72e62-83fb-4306-b430-5b8e7e0b07cf/cni-plugins/0.log" Jun 05 15:52:56.256204 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.256176 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nxhbx_82c72e62-83fb-4306-b430-5b8e7e0b07cf/bond-cni-plugin/0.log" Jun 05 15:52:56.282498 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.282448 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nxhbx_82c72e62-83fb-4306-b430-5b8e7e0b07cf/routeoverride-cni/0.log" Jun 05 15:52:56.305718 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.305689 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nxhbx_82c72e62-83fb-4306-b430-5b8e7e0b07cf/whereabouts-cni-bincopy/0.log" Jun 05 15:52:56.327340 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.327312 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nxhbx_82c72e62-83fb-4306-b430-5b8e7e0b07cf/whereabouts-cni/0.log" Jun 05 15:52:56.374749 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.374713 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-c2tmt_80f4b42a-22e7-42b5-a5a9-419031117648/discovery/0.log" Jun 05 15:52:56.394403 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.394374 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p9nfc_1dcc8331-f089-4f91-9d6b-d764d58734e0/kube-multus/0.log" Jun 05 15:52:56.401584 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.401558 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-656445bd89-qdbkx_37927820-27bc-4821-9c15-6aaffa9151c1/kube-auth-proxy/0.log" Jun 05 15:52:56.450133 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.450054 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-rzr5v_ff92c123-a23d-429e-aa04-1f42da5c330e/payload-processing/0.log" Jun 05 15:52:56.450475 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.450460 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8wl98_44c3fb43-2064-4313-bcec-49d65a2676da/network-metrics-daemon/0.log" Jun 05 15:52:56.473781 ip-10-0-140-178 kubenswrapper[2572]: I0605 15:52:56.473754 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8wl98_44c3fb43-2064-4313-bcec-49d65a2676da/kube-rbac-proxy/0.log"