Jun 14 21:33:31.535859 ip-10-0-128-159 systemd[1]: Starting Kubernetes Kubelet... Jun 14 21:33:31.922171 ip-10-0-128-159 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 21:33:31.922171 ip-10-0-128-159 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 21:33:31.922171 ip-10-0-128-159 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 21:33:31.922171 ip-10-0-128-159 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 21:33:31.922171 ip-10-0-128-159 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 21:33:31.924091 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.924006 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 21:33:31.929212 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929196 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929214 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929219 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929222 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929225 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929230 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929234 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929237 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929240 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929243 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929246 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929249 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929251 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929254 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929256 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:31.929255 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929261 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929265 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929268 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929271 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929280 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929283 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929286 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929289 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929291 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929294 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929296 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929299 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929301 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929304 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929307 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929309 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929312 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929314 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929317 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929319 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:31.929635 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929322 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929324 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929327 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929329 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929332 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929334 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929337 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929340 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929349 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929351 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929354 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929357 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929359 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929362 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929365 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929368 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929370 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929373 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929376 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929379 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:31.930110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929381 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929384 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929387 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929389 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929392 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929394 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929397 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929400 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929402 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929405 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929407 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929410 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929413 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929416 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929418 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929421 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929423 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929426 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929428 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929431 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:31.930731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929434 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929437 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929439 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929442 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929445 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929448 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929451 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929454 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929456 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929459 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929462 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929465 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929467 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929470 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929473 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929475 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929478 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929480 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929482 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929486 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:31.931215 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929490 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929493 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929495 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.929499 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930234 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930241 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930245 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930248 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930251 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930255 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930258 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930260 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930264 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930267 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930270 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930273 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930275 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930278 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930281 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930283 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:31.931705 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930286 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930289 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930291 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930295 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930297 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930300 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930303 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930305 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930308 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930311 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930313 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930316 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930318 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930321 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930323 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930326 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930329 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930333 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930337 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:31.932227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930340 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930343 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930346 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930349 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930352 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930356 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930359 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930362 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930365 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930368 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930370 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930373 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930376 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930378 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930381 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930383 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930386 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930389 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930392 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930394 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:31.932753 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930397 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930399 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930401 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930404 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930407 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930409 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930412 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930414 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930418 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930420 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930422 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930425 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930427 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930430 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930434 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930437 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930439 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930442 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930445 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:31.933238 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930448 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930450 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930453 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930455 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930458 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930460 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930463 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930466 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930469 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930472 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930474 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930477 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930480 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930482 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930486 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930490 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930493 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930495 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930498 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:31.933722 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930500 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930503 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930506 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930509 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930512 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.930514 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931332 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931340 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931344 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931348 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931351 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931354 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931357 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931361 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931363 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931366 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931369 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931372 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931374 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931377 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:31.934173 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931379 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931382 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931385 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931387 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931402 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931405 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931409 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931411 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931414 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931417 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931419 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931422 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931425 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931428 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931430 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931433 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931435 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931438 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931441 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931443 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:31.934674 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931446 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931448 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931451 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931453 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931456 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931459 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931461 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931464 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931466 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931469 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931471 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931474 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931476 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931479 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931481 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931484 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931487 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931492 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931496 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:31.935165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931500 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931503 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931505 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931508 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931511 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931513 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931516 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931518 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931521 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931523 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931526 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931528 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931531 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931533 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931536 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931538 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931541 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931545 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931548 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931551 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:31.935633 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931553 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931556 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931559 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931561 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931564 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931580 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931587 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931591 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931594 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931597 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931599 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931603 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931606 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931610 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931613 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931616 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931619 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931622 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931625 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:31.936103 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931628 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931630 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931632 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931650 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931655 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931658 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.931663 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931733 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931741 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931747 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931752 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931759 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931764 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931776 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931780 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931784 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931787 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931791 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931794 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931799 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931802 2562 flags.go:64] FLAG: --cgroup-root="" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931805 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 21:33:31.936559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931808 2562 flags.go:64] FLAG: --client-ca-file="" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931812 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931815 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931820 2562 flags.go:64] FLAG: --cluster-domain="" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931823 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931826 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931829 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931833 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931837 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931840 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931843 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931846 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931849 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931852 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931855 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931858 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931861 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931865 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931868 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931871 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931874 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931877 2562 flags.go:64] FLAG: --enable-server="true" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931880 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931885 2562 flags.go:64] FLAG: --event-burst="100" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931888 2562 flags.go:64] FLAG: --event-qps="50" Jun 14 21:33:31.937084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931891 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931894 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931897 2562 flags.go:64] FLAG: --eviction-hard="" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931901 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931906 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931909 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931911 2562 flags.go:64] FLAG: --eviction-soft="" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931915 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931918 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931921 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931924 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931927 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931930 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931934 2562 flags.go:64] FLAG: --feature-gates="" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931937 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931940 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931943 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931946 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931950 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931953 2562 flags.go:64] FLAG: --help="false" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931955 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-159.ec2.internal" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931959 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931961 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 21:33:31.937686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931965 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931968 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931971 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931974 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931977 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931979 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931982 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931985 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931988 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931991 2562 flags.go:64] FLAG: --kube-reserved="" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931994 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.931997 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932000 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932004 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932007 2562 flags.go:64] FLAG: --lock-file="" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932009 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932012 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932016 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932022 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932025 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932028 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932031 2562 flags.go:64] FLAG: --logging-format="text" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932035 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932038 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 21:33:31.938476 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932041 2562 flags.go:64] FLAG: --manifest-url="" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932044 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932048 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932051 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932055 2562 flags.go:64] FLAG: --max-pods="110" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932058 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932061 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932064 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932066 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932069 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932072 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932075 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932082 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932085 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932088 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932091 2562 flags.go:64] FLAG: --pod-cidr="" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932094 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932100 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932104 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932107 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932110 2562 flags.go:64] FLAG: --port="10250" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932113 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932118 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f06615fec3c85a9b" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932121 2562 flags.go:64] FLAG: --qos-reserved="" Jun 14 21:33:31.939407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932124 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932127 2562 flags.go:64] FLAG: --register-node="true" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932129 2562 flags.go:64] FLAG: --register-with-taints="" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932133 2562 flags.go:64] FLAG: --registry-burst="10" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932136 2562 flags.go:64] FLAG: --registry-qps="5" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932139 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932143 2562 flags.go:64] FLAG: --reserved-memory="" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932149 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932152 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932155 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932158 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932161 2562 flags.go:64] FLAG: --runonce="false" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932164 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932167 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932170 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932172 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932175 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932178 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932181 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932184 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932187 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932190 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932193 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932196 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932199 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 21:33:31.940029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932202 2562 flags.go:64] FLAG: --system-cgroups="" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932207 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932212 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932215 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932217 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932223 2562 flags.go:64] FLAG: --tls-min-version="" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932226 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932229 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932232 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932235 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932238 2562 flags.go:64] FLAG: --v="2" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932242 2562 flags.go:64] FLAG: --version="false" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932247 2562 flags.go:64] FLAG: --vmodule="" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932251 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932255 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932368 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932371 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932375 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932378 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932380 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932384 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932386 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932389 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:31.940659 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932392 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932396 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932400 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932403 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932406 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932408 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932411 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932413 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932416 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932418 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932422 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932425 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932427 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932430 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932442 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932445 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932448 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932451 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932453 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:31.941233 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932456 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932458 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932461 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932463 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932466 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932469 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932472 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932475 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932477 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932481 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932484 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932487 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932491 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932493 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932496 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932499 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932501 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932504 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932506 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:31.941726 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932509 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932512 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932514 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932517 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932521 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932524 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932526 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932529 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932533 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932536 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932538 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932541 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932544 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932546 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932549 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932552 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932554 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932556 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932560 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932563 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:31.942231 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932566 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932582 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932585 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932587 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932590 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932593 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932596 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932599 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932601 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932604 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932607 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932609 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932613 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932615 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932618 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932620 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932627 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932631 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932635 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932638 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:31.942733 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932642 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932645 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932648 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932650 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932653 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932655 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932658 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932660 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932663 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932665 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932668 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932670 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.932674 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.932679 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.940860 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 21:33:31.943227 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.940990 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.941010 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.941015 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941073 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941078 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941081 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941085 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941088 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941091 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941094 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941097 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941101 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941105 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941108 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941111 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941114 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941117 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941120 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941123 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941126 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:31.943605 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941128 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941131 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941134 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941137 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941139 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941142 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941145 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941148 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941150 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941153 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941156 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941159 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941162 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941165 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941168 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941171 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941173 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941176 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941179 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941181 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:31.944092 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941184 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941186 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941189 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941192 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941194 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941197 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941200 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941202 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941205 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941209 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941211 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941215 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941218 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941221 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941223 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941226 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941228 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941231 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941233 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:31.944594 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941236 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941239 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941242 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941244 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941247 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941251 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941254 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941257 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941260 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941262 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941265 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941268 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941270 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941273 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941275 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941278 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941280 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941283 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941285 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941288 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:31.945110 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941291 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941293 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941296 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941300 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941302 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941305 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941307 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941310 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941312 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941315 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941317 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941321 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941325 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941328 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941331 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941333 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941336 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941340 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941343 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941345 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:31.945645 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941348 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941351 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941354 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.941359 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941468 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941473 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941476 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941479 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941482 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941485 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941488 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941490 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941493 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941495 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941498 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:31.946146 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941500 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941504 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941506 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941509 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941513 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941516 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941519 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941522 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941525 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941528 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941530 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941533 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941536 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941538 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941541 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941545 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941547 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941550 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941552 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:31.946511 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941555 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941558 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941560 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941563 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941580 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941584 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941587 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941590 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941593 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941595 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941598 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941600 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941603 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941606 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941608 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941612 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941615 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941617 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941620 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941622 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:31.946987 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941625 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941628 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941630 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941633 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941635 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941638 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941641 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941644 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941646 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941649 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941651 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941654 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941657 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941659 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941662 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941664 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941667 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941670 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941672 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941675 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:31.947470 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941677 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941680 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941683 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941685 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941688 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941692 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941695 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941698 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941702 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941706 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941710 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941713 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941716 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941719 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941722 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941724 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941727 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941730 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941733 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:31.948087 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941736 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941739 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941742 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941744 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941747 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941749 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941752 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941754 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941757 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:31.941760 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.941764 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.941866 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.944669 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.945904 2562 server.go:1019] "Starting client certificate rotation" Jun 14 21:33:31.948590 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.946004 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 21:33:31.948970 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.946038 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 21:33:31.948970 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.948387 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 21:33:31.953614 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.953595 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 21:33:31.961332 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.961312 2562 log.go:25] "Validated CRI v1 runtime API" Jun 14 21:33:31.964474 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.964423 2562 log.go:25] "Validated CRI v1 image API" Jun 14 21:33:31.965315 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.965295 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 21:33:31.970053 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.970026 2562 fs.go:135] Filesystem UUIDs: map[2fb6c8c7-cfcd-4912-a8ee-fe615246e3a5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 884d6dbf-fbc8-48e5-89fa-e87ec79b8f97:/dev/nvme0n1p4] Jun 14 21:33:31.970128 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.970054 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 21:33:31.975325 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.975303 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 21:33:31.975834 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.975518 2562 manager.go:216] Machine: {Timestamp:2026-06-14 21:33:31.973744788 +0000 UTC m=+0.324364652 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103512 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c3af9133b749850820b4e56c6476 SystemUUID:ec22c3af-9133-b749-8508-20b4e56c6476 BootID:7f7d24e1-03ad-4cd0-af19-e42b786d0e1a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:69:83:cf:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:69:83:cf:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:f1:9b:74:37:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 21:33:31.975834 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.975835 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 21:33:31.975975 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.975962 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 21:33:31.979106 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.979082 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 21:33:31.979230 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.979107 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 21:33:31.979731 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.979721 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 21:33:31.979763 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.979734 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 21:33:31.979763 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.979742 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 21:33:31.980279 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.980270 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 21:33:31.981384 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.981373 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 21:33:31.985221 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.985210 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 14 21:33:31.985340 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.985331 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 21:33:31.985371 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.985359 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 14 21:33:31.985405 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.985370 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 21:33:31.985405 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.985388 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 21:33:31.985405 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.985399 2562 kubelet.go:398] "Adding apiserver pod source" Jun 14 21:33:31.985483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.985408 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 21:33:31.986040 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.986027 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 21:33:31.986081 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.986048 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 21:33:31.988828 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.988811 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 21:33:31.990461 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.990446 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 21:33:31.990532 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.990476 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 21:33:31.991015 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991004 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 21:33:31.991077 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991019 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 21:33:31.991077 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991025 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 21:33:31.991077 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991030 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 21:33:31.991077 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991039 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 21:33:31.991077 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991048 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 21:33:31.991254 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991245 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 21:33:31.991254 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991254 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 21:33:31.991309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991261 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 21:33:31.991309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991267 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 21:33:31.991309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991276 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 21:33:31.991309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.991306 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 21:33:31.992162 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.992151 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 21:33:31.992162 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.992161 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 21:33:31.993159 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.993141 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mfkf6" Jun 14 21:33:31.995201 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:31.995182 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 21:33:31.995201 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:31.995188 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 21:33:31.995288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.995209 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 21:33:31.995605 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.995591 2562 server.go:1268] "Started kubelet" Jun 14 21:33:31.995662 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.995642 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 21:33:31.995768 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.995716 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 21:33:31.995816 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.995795 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 21:33:31.997151 ip-10-0-128-159 systemd[1]: Started Kubernetes Kubelet. Jun 14 21:33:31.997517 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.997240 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 21:33:31.998281 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:31.998267 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 14 21:33:32.000386 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.000370 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mfkf6" Jun 14 21:33:32.001800 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.001779 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 21:33:32.002421 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.001426 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-159.ec2.internal.18b910157802a322 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-159.ec2.internal,UID:ip-10-0-128-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-159.ec2.internal,},FirstTimestamp:2026-06-14 21:33:31.99553821 +0000 UTC m=+0.346158071,LastTimestamp:2026-06-14 21:33:31.99553821 +0000 UTC m=+0.346158071,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-159.ec2.internal,}" Jun 14 21:33:32.003022 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.002999 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 21:33:32.003109 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.002998 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 21:33:32.003179 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.003109 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.003595 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.003563 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 21:33:32.003688 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.003627 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 21:33:32.003760 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.003723 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 14 21:33:32.003760 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.003735 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 14 21:33:32.003862 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.003835 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 21:33:32.003986 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.003970 2562 factory.go:55] Registering systemd factory Jun 14 21:33:32.004043 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.003990 2562 factory.go:223] Registration of the systemd container factory successfully Jun 14 21:33:32.004227 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.004211 2562 factory.go:153] Registering CRI-O factory Jun 14 21:33:32.004324 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.004229 2562 factory.go:223] Registration of the crio container factory successfully Jun 14 21:33:32.004324 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.004297 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 21:33:32.004324 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.004324 2562 factory.go:103] Registering Raw factory Jun 14 21:33:32.004494 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.004338 2562 manager.go:1196] Started watching for new ooms in manager Jun 14 21:33:32.005345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.005319 2562 manager.go:349] Starting recovery of all containers Jun 14 21:33:32.006408 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.006385 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 21:33:32.006471 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.006388 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 21:33:32.013981 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.013941 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 21:33:32.016940 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.016921 2562 manager.go:354] Recovery completed Jun 14 21:33:32.021494 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.021482 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:32.023373 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.023359 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:32.023425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.023388 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:32.023425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.023398 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:32.024004 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.023991 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 21:33:32.024004 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.023999 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:32.024004 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.024003 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 21:33:32.024130 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.024018 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 14 21:33:32.024723 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.024706 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:32.024781 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.024733 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:32.024781 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.024743 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:32.026076 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.026065 2562 policy_none.go:49] "None policy: Start" Jun 14 21:33:32.026114 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.026080 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 21:33:32.026114 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.026090 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 21:33:32.028048 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.028037 2562 policy_none.go:47] "Start" Jun 14 21:33:32.065230 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.065212 2562 manager.go:337] "Starting Device Plugin manager" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.065297 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.065313 2562 server.go:87] "Starting device plugin registration server" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.065553 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.065563 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.065714 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.065801 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.065810 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.066611 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.066664 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.074548 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.074596 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.074624 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.074691 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 21:33:32.091104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.076599 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:32.165789 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.165737 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:32.166746 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.166729 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:32.166813 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.166764 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:32.166813 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.166778 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:32.166813 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.166802 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.174875 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.174788 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal"] Jun 14 21:33:32.174875 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.174867 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:32.175965 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.175945 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.176080 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.175969 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-159.ec2.internal\": node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.176304 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.176285 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:32.176350 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.176330 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:32.176391 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.176349 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:32.178581 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.178560 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:32.178730 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.178716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.178769 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.178745 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:32.179386 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.179367 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:32.179492 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.179399 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:32.179492 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.179410 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:32.179492 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.179372 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:32.179492 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.179466 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:32.179492 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.179477 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:32.181475 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.181456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.181559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.181486 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:32.182193 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.182174 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:32.182247 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.182210 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:32.182247 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.182226 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:32.192704 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.192680 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.205209 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.205190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ceb1b81d7c3613bb64f8bbca4ea6dacb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"ceb1b81d7c3613bb64f8bbca4ea6dacb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.205280 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.205216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceb1b81d7c3613bb64f8bbca4ea6dacb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"ceb1b81d7c3613bb64f8bbca4ea6dacb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.205280 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.205253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ed6de627129f31f4d7226feeb6c47d8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-159.ec2.internal\" (UID: \"8ed6de627129f31f4d7226feeb6c47d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.205345 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.205284 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-159.ec2.internal\" not found" node="ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.209965 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.209949 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-159.ec2.internal\" not found" node="ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.293403 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.293372 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.305701 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.305676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ceb1b81d7c3613bb64f8bbca4ea6dacb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"ceb1b81d7c3613bb64f8bbca4ea6dacb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.305817 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.305704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceb1b81d7c3613bb64f8bbca4ea6dacb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"ceb1b81d7c3613bb64f8bbca4ea6dacb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.305817 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.305727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ed6de627129f31f4d7226feeb6c47d8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-159.ec2.internal\" (UID: \"8ed6de627129f31f4d7226feeb6c47d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.305817 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.305755 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ed6de627129f31f4d7226feeb6c47d8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-159.ec2.internal\" (UID: \"8ed6de627129f31f4d7226feeb6c47d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.305817 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.305782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ceb1b81d7c3613bb64f8bbca4ea6dacb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"ceb1b81d7c3613bb64f8bbca4ea6dacb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.305817 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.305789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceb1b81d7c3613bb64f8bbca4ea6dacb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal\" (UID: \"ceb1b81d7c3613bb64f8bbca4ea6dacb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.393999 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.393952 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.494734 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.494653 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.508104 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.508072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.513559 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.513534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" Jun 14 21:33:32.595819 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.595777 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.696278 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.696246 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.796927 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.796837 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.897374 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.897343 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:32.945886 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.945858 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 21:33:32.946481 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:32.946001 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 21:33:32.998120 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:32.998093 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:33.005309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.005272 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 21:28:31 +0000 UTC" deadline="2028-01-05 00:51:48.437341683 +0000 UTC" Jun 14 21:33:33.005309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.005309 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13659h18m15.43203638s" Jun 14 21:33:33.032590 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:33.032532 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed6de627129f31f4d7226feeb6c47d8.slice/crio-ac97a65aa87e2304258fe2ef5a7a9debe82c4d60bdd4216f3ee022dc0e5b4a25 WatchSource:0}: Error finding container ac97a65aa87e2304258fe2ef5a7a9debe82c4d60bdd4216f3ee022dc0e5b4a25: Status 404 returned error can't find the container with id ac97a65aa87e2304258fe2ef5a7a9debe82c4d60bdd4216f3ee022dc0e5b4a25 Jun 14 21:33:33.033032 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:33.033015 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb1b81d7c3613bb64f8bbca4ea6dacb.slice/crio-38312a4632c402616ea53e1e6933c72a6e9d7634ab57ac6c09a18c802367bcb7 WatchSource:0}: Error finding container 38312a4632c402616ea53e1e6933c72a6e9d7634ab57ac6c09a18c802367bcb7: Status 404 returned error can't find the container with id 38312a4632c402616ea53e1e6933c72a6e9d7634ab57ac6c09a18c802367bcb7 Jun 14 21:33:33.037333 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.037318 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 21:33:33.077613 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.077509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" event={"ID":"8ed6de627129f31f4d7226feeb6c47d8","Type":"ContainerStarted","Data":"ac97a65aa87e2304258fe2ef5a7a9debe82c4d60bdd4216f3ee022dc0e5b4a25"} Jun 14 21:33:33.078437 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.078417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" event={"ID":"ceb1b81d7c3613bb64f8bbca4ea6dacb","Type":"ContainerStarted","Data":"38312a4632c402616ea53e1e6933c72a6e9d7634ab57ac6c09a18c802367bcb7"} Jun 14 21:33:33.098648 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:33.098621 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:33.199108 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:33.199080 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:33.240619 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.240588 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:33.299461 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:33.299432 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-159.ec2.internal\" not found" Jun 14 21:33:33.316748 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.316728 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:33.393001 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.392909 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:33.404030 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.404000 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" Jun 14 21:33:33.414389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.414363 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 21:33:33.415405 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.415382 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" Jun 14 21:33:33.423225 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.423196 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 21:33:33.878890 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.878813 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:33.987002 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.986967 2562 apiserver.go:52] "Watching apiserver" Jun 14 21:33:33.992452 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.992421 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 21:33:33.993662 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.993630 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-57wst","kube-system/global-pull-secret-syncer-s9fvf","kube-system/konnectivity-agent-hqcn6","kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hxrgq","openshift-multus/multus-additional-cni-plugins-f9jsc","openshift-multus/network-metrics-daemon-qj4f9","openshift-ovn-kubernetes/ovnkube-node-jhvtv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh","openshift-dns/node-resolver-f8zpj","openshift-image-registry/node-ca-d5z8n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal","openshift-multus/multus-g4rtr","openshift-network-diagnostics/network-check-target-48vvv"] Jun 14 21:33:33.996191 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.996170 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:33.998352 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.998305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 21:33:33.998352 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.998310 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4rtr" Jun 14 21:33:33.998487 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.998370 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5k8hj\"" Jun 14 21:33:33.998487 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:33.998455 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 21:33:34.000133 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.000115 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 21:33:34.000321 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.000302 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 21:33:34.000417 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.000381 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k5k86\"" Jun 14 21:33:34.000417 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.000389 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 21:33:34.000536 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.000498 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 21:33:34.000604 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.000595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.002285 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.002260 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27w7q\"" Jun 14 21:33:34.002385 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.002311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 21:33:34.002385 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.002325 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 21:33:34.002770 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.002751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:34.002864 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.002825 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:34.004427 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.004316 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 21:33:34.005195 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.004943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.006810 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.006790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 21:33:34.006910 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.006854 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8wjv\"" Jun 14 21:33:34.007092 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.007072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 21:33:34.007195 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.007148 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.008905 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.008887 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 21:33:34.009058 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.008954 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 21:33:34.009058 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.009036 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jd8kw\"" Jun 14 21:33:34.009951 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.009935 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.014088 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.012898 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 21:33:34.014088 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.013021 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wl77n\"" Jun 14 21:33:34.014088 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.013141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 21:33:34.014088 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.013244 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 21:33:34.014326 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.014156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:34.014326 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.014240 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:34.015633 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.015593 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 21:33:34.015813 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.015792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-lib-modules\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.015908 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.015827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-var-lib-kubelet\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.015908 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.015854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-system-cni-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.016424 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.015877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-cni-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.016508 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.016508 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-k8s-cni-cncf-io\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.016637 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-conf-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.016637 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.016542 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:34.016637 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-kubernetes\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.016637 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-systemd\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.016811 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-sys\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.016811 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15cb6195-96bd-4145-9d5e-381be5c30074-tmp\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.016811 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-hosts-file\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.016811 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-tmp-dir\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.016811 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-cnibin\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysconfig\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysctl-conf\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwh5t\" (UniqueName: \"kubernetes.io/projected/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-kube-api-access-rwh5t\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/957388b6-85fb-4539-ab38-a1c584af238a-cni-binary-copy\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-kubelet\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-hostroot\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.016981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drghq\" (UniqueName: \"kubernetes.io/projected/957388b6-85fb-4539-ab38-a1c584af238a-kube-api-access-drghq\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysctl-d\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-run\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-socket-dir-parent\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/957388b6-85fb-4539-ab38-a1c584af238a-multus-daemon-config\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-modprobe-d\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-cni-multus\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-multus-certs\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02c515c5-0202-409c-9849-d94d4f44ef2a-konnectivity-ca\") pod \"konnectivity-agent-hqcn6\" (UID: \"02c515c5-0202-409c-9849-d94d4f44ef2a\") " pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqbsz\" (UniqueName: \"kubernetes.io/projected/15cb6195-96bd-4145-9d5e-381be5c30074-kube-api-access-fqbsz\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-cni-bin\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-etc-kubernetes\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:34.017799 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-host\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017799 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15cb6195-96bd-4145-9d5e-381be5c30074-etc-tuned\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.017799 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-os-release\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017799 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-netns\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.017799 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.017487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02c515c5-0202-409c-9849-d94d4f44ef2a-agent-certs\") pod \"konnectivity-agent-hqcn6\" (UID: \"02c515c5-0202-409c-9849-d94d4f44ef2a\") " pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.018536 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.018515 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.020477 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.020422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 21:33:34.020593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.020494 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 21:33:34.020593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.020523 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 21:33:34.020702 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.020661 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jpfmw\"" Jun 14 21:33:34.020942 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.020923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.022739 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.022718 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 21:33:34.022866 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.022810 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 21:33:34.022952 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.022935 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 21:33:34.023000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.022954 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9xm85\"" Jun 14 21:33:34.023362 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.023347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.025209 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.025184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 21:33:34.025395 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.025379 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 21:33:34.025709 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.025516 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 21:33:34.025709 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.025528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vmhrf\"" Jun 14 21:33:34.025709 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.025565 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 21:33:34.025892 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.025819 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 21:33:34.026253 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.026234 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 21:33:34.038294 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.038272 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpvmp" Jun 14 21:33:34.045371 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.045351 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpvmp" Jun 14 21:33:34.106153 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.106122 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 21:33:34.118259 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-cni-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.118259 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-k8s-cni-cncf-io\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-kubernetes\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-sys\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15cb6195-96bd-4145-9d5e-381be5c30074-tmp\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-hosts-file\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-k8s-cni-cncf-io\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118386 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-kubernetes\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118401 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-hosts-file\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-cni-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.118463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysctl-conf\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-sys\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-kubelet\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwh5t\" (UniqueName: \"kubernetes.io/projected/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-kube-api-access-rwh5t\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-kubelet\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118625 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysctl-conf\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drghq\" (UniqueName: \"kubernetes.io/projected/957388b6-85fb-4539-ab38-a1c584af238a-kube-api-access-drghq\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-kubelet\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysctl-d\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-run\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118774 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-os-release\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-etc-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-ovn\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysctl-d\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118860 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-run\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.118877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/957388b6-85fb-4539-ab38-a1c584af238a-multus-daemon-config\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b3d6888-b153-4809-b707-ec7b852a8341-serviceca\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.118976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2267a16-a530-42bf-ae41-2f080b488a89-kubelet-config\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-cni-multus\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvzhm\" (UniqueName: \"kubernetes.io/projected/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-kube-api-access-hvzhm\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-cni-multus\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovnkube-config\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02c515c5-0202-409c-9849-d94d4f44ef2a-konnectivity-ca\") pod \"konnectivity-agent-hqcn6\" (UID: \"02c515c5-0202-409c-9849-d94d4f44ef2a\") " pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqbsz\" (UniqueName: \"kubernetes.io/projected/15cb6195-96bd-4145-9d5e-381be5c30074-kube-api-access-fqbsz\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-etc-kubernetes\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-host\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-etc-kubernetes\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-host\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15cb6195-96bd-4145-9d5e-381be5c30074-etc-tuned\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-system-cni-dir\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.119593 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cnibin\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/957388b6-85fb-4539-ab38-a1c584af238a-multus-daemon-config\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2j48\" (UniqueName: \"kubernetes.io/projected/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-kube-api-access-n2j48\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-lib-modules\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75kz\" (UniqueName: \"kubernetes.io/projected/35a7518d-ac6d-4a64-96dd-bdeaff580470-kube-api-access-l75kz\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-systemd-units\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-system-cni-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-lib-modules\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-conf-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-systemd\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-conf-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119686 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-system-cni-dir\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-systemd\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.120295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02c515c5-0202-409c-9849-d94d4f44ef2a-konnectivity-ca\") pod \"konnectivity-agent-hqcn6\" (UID: \"02c515c5-0202-409c-9849-d94d4f44ef2a\") " pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-tmp-dir\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-cnibin\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysconfig\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/957388b6-85fb-4539-ab38-a1c584af238a-cni-binary-copy\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-cnibin\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-hostroot\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-sysconfig\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-device-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-hostroot\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.119995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-run-netns\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-cni-netd\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-tmp-dir\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-socket-dir-parent\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120086 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-modprobe-d\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-multus-socket-dir-parent\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b3d6888-b153-4809-b707-ec7b852a8341-host\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.120934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9txx\" (UniqueName: \"kubernetes.io/projected/2b3d6888-b153-4809-b707-ec7b852a8341-kube-api-access-k9txx\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-var-lib-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120171 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-etc-modprobe-d\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-log-socket\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-cni-bin\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-env-overrides\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-multus-certs\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-slash\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-multus-certs\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovn-node-metrics-cert\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2267a16-a530-42bf-ae41-2f080b488a89-dbus\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2240902e-c3a1-4417-a4c8-649a26984810-iptables-alerter-script\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2240902e-c3a1-4417-a4c8-649a26984810-host-slash\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/957388b6-85fb-4539-ab38-a1c584af238a-cni-binary-copy\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.121496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovnkube-script-lib\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-cni-bin\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-node-log\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-var-lib-cni-bin\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6m2v\" (UniqueName: \"kubernetes.io/projected/2240902e-c3a1-4417-a4c8-649a26984810-kube-api-access-w6m2v\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-os-release\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-netns\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02c515c5-0202-409c-9849-d94d4f44ef2a-agent-certs\") pod \"konnectivity-agent-hqcn6\" (UID: \"02c515c5-0202-409c-9849-d94d4f44ef2a\") " pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-host-run-netns\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-var-lib-kubelet\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/957388b6-85fb-4539-ab38-a1c584af238a-os-release\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15cb6195-96bd-4145-9d5e-381be5c30074-var-lib-kubelet\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-systemd\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh6w2\" (UniqueName: \"kubernetes.io/projected/8aeb0415-7757-4cb7-8c29-f641f9a46ead-kube-api-access-hh6w2\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.122342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.120842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.123209 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.121775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15cb6195-96bd-4145-9d5e-381be5c30074-tmp\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.123209 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.121819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15cb6195-96bd-4145-9d5e-381be5c30074-etc-tuned\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.123209 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.122633 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02c515c5-0202-409c-9849-d94d4f44ef2a-agent-certs\") pod \"konnectivity-agent-hqcn6\" (UID: \"02c515c5-0202-409c-9849-d94d4f44ef2a\") " pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.128365 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.128339 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:34.128365 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.128363 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:34.128673 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.128375 2562 projected.go:196] Error preparing data for projected volume kube-api-access-6ftf9 for pod openshift-network-diagnostics/network-check-target-48vvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:34.128673 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.128444 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9 podName:6e0afad5-f98e-4551-a1b3-9d59aee059e6 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:34.628421099 +0000 UTC m=+2.979040968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftf9" (UniqueName: "kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9") pod "network-check-target-48vvv" (UID: "6e0afad5-f98e-4551-a1b3-9d59aee059e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:34.130669 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.130550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drghq\" (UniqueName: \"kubernetes.io/projected/957388b6-85fb-4539-ab38-a1c584af238a-kube-api-access-drghq\") pod \"multus-g4rtr\" (UID: \"957388b6-85fb-4539-ab38-a1c584af238a\") " pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.130948 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.130930 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwh5t\" (UniqueName: \"kubernetes.io/projected/996f5f9e-8ec3-4f0f-95a5-84b68d052d83-kube-api-access-rwh5t\") pod \"node-resolver-f8zpj\" (UID: \"996f5f9e-8ec3-4f0f-95a5-84b68d052d83\") " pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.131030 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.130955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqbsz\" (UniqueName: \"kubernetes.io/projected/15cb6195-96bd-4145-9d5e-381be5c30074-kube-api-access-fqbsz\") pod \"tuned-hxrgq\" (UID: \"15cb6195-96bd-4145-9d5e-381be5c30074\") " pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.221603 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.221775 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:34.221775 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.221775 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.221719 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:34.221775 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-systemd\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.221775 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.221772 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:34.721756081 +0000 UTC m=+3.072375929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-systemd\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh6w2\" (UniqueName: \"kubernetes.io/projected/8aeb0415-7757-4cb7-8c29-f641f9a46ead-kube-api-access-hh6w2\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-kubelet\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221944 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.221953 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-kubelet\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-os-release\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.222035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-etc-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-ovn\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b3d6888-b153-4809-b707-ec7b852a8341-serviceca\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2267a16-a530-42bf-ae41-2f080b488a89-kubelet-config\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-ovn\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222141 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-os-release\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvzhm\" (UniqueName: \"kubernetes.io/projected/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-kube-api-access-hvzhm\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-etc-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2267a16-a530-42bf-ae41-2f080b488a89-kubelet-config\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovnkube-config\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-system-cni-dir\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cnibin\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2j48\" (UniqueName: \"kubernetes.io/projected/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-kube-api-access-n2j48\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cnibin\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.222489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75kz\" (UniqueName: \"kubernetes.io/projected/35a7518d-ac6d-4a64-96dd-bdeaff580470-kube-api-access-l75kz\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-system-cni-dir\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-systemd-units\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.222554 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222556 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b3d6888-b153-4809-b707-ec7b852a8341-serviceca\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.222618 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret podName:b2267a16-a530-42bf-ae41-2f080b488a89 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:34.722602168 +0000 UTC m=+3.073222022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret") pod "global-pull-secret-syncer-s9fvf" (UID: "b2267a16-a530-42bf-ae41-2f080b488a89") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222616 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-device-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-device-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-systemd-units\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-run-netns\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-cni-netd\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-run-netns\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.223308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b3d6888-b153-4809-b707-ec7b852a8341-host\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b3d6888-b153-4809-b707-ec7b852a8341-host\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-cni-netd\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9txx\" (UniqueName: \"kubernetes.io/projected/2b3d6888-b153-4809-b707-ec7b852a8341-kube-api-access-k9txx\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-var-lib-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-log-socket\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-cni-bin\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-env-overrides\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-var-lib-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-slash\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovnkube-config\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-log-socket\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.222995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223013 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-cni-bin\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223015 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-run-openvswitch\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovn-node-metrics-cert\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2267a16-a530-42bf-ae41-2f080b488a89-dbus\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2240902e-c3a1-4417-a4c8-649a26984810-iptables-alerter-script\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2240902e-c3a1-4417-a4c8-649a26984810-host-slash\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2267a16-a530-42bf-ae41-2f080b488a89-dbus\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovnkube-script-lib\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2240902e-c3a1-4417-a4c8-649a26984810-host-slash\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-node-log\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-host-slash\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6m2v\" (UniqueName: \"kubernetes.io/projected/2240902e-c3a1-4417-a4c8-649a26984810-kube-api-access-w6m2v\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-env-overrides\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aeb0415-7757-4cb7-8c29-f641f9a46ead-node-log\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.224681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223473 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.225180 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovnkube-script-lib\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.225180 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.223690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2240902e-c3a1-4417-a4c8-649a26984810-iptables-alerter-script\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.225180 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.224367 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.226014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.225996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aeb0415-7757-4cb7-8c29-f641f9a46ead-ovn-node-metrics-cert\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.232798 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.232775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75kz\" (UniqueName: \"kubernetes.io/projected/35a7518d-ac6d-4a64-96dd-bdeaff580470-kube-api-access-l75kz\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:34.232920 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.232774 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2j48\" (UniqueName: \"kubernetes.io/projected/b3fda755-d1ab-4e55-8e71-05bc2c883e8b-kube-api-access-n2j48\") pod \"aws-ebs-csi-driver-node-gr8zh\" (UID: \"b3fda755-d1ab-4e55-8e71-05bc2c883e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.232985 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.232915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6m2v\" (UniqueName: \"kubernetes.io/projected/2240902e-c3a1-4417-a4c8-649a26984810-kube-api-access-w6m2v\") pod \"iptables-alerter-57wst\" (UID: \"2240902e-c3a1-4417-a4c8-649a26984810\") " pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.232985 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.232938 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh6w2\" (UniqueName: \"kubernetes.io/projected/8aeb0415-7757-4cb7-8c29-f641f9a46ead-kube-api-access-hh6w2\") pod \"ovnkube-node-jhvtv\" (UID: \"8aeb0415-7757-4cb7-8c29-f641f9a46ead\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.233266 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.233237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9txx\" (UniqueName: \"kubernetes.io/projected/2b3d6888-b153-4809-b707-ec7b852a8341-kube-api-access-k9txx\") pod \"node-ca-d5z8n\" (UID: \"2b3d6888-b153-4809-b707-ec7b852a8341\") " pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.233419 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.233391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvzhm\" (UniqueName: \"kubernetes.io/projected/2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5-kube-api-access-hvzhm\") pod \"multus-additional-cni-plugins-f9jsc\" (UID: \"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5\") " pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.308366 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.308305 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8zpj" Jun 14 21:33:34.318138 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.318111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4rtr" Jun 14 21:33:34.326150 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.326125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:34.332941 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.332922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" Jun 14 21:33:34.337622 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.337595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" Jun 14 21:33:34.344163 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.344144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" Jun 14 21:33:34.352827 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.352808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-57wst" Jun 14 21:33:34.359446 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.359430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d5z8n" Jun 14 21:33:34.364224 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.364203 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:34.726165 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.726136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:34.726362 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.726192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:34.726362 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:34.726217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:34.726362 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726279 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:34.726362 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726316 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:34.726362 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726355 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:35.726336247 +0000 UTC m=+4.076956097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:34.726362 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726359 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:34.726706 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726371 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret podName:b2267a16-a530-42bf-ae41-2f080b488a89 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:35.726364699 +0000 UTC m=+4.076984548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret") pod "global-pull-secret-syncer-s9fvf" (UID: "b2267a16-a530-42bf-ae41-2f080b488a89") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:34.726706 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726377 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:34.726706 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726390 2562 projected.go:196] Error preparing data for projected volume kube-api-access-6ftf9 for pod openshift-network-diagnostics/network-check-target-48vvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:34.726706 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:34.726442 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9 podName:6e0afad5-f98e-4551-a1b3-9d59aee059e6 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:35.726426431 +0000 UTC m=+4.077046338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftf9" (UniqueName: "kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9") pod "network-check-target-48vvv" (UID: "6e0afad5-f98e-4551-a1b3-9d59aee059e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:34.803126 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:34.803084 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddf2357_17ba_4b4d_b707_e1f6e8b43ba5.slice/crio-cc24ca86968df515ef1802b3fb122e7cb43d27ab096178736046a3bce5d924f8 WatchSource:0}: Error finding container cc24ca86968df515ef1802b3fb122e7cb43d27ab096178736046a3bce5d924f8: Status 404 returned error can't find the container with id cc24ca86968df515ef1802b3fb122e7cb43d27ab096178736046a3bce5d924f8 Jun 14 21:33:34.804108 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:34.804086 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c515c5_0202_409c_9849_d94d4f44ef2a.slice/crio-243cfb0027607907a32f621f56e9407ccf2955407a966dca56ff1542a499baaa WatchSource:0}: Error finding container 243cfb0027607907a32f621f56e9407ccf2955407a966dca56ff1542a499baaa: Status 404 returned error can't find the container with id 243cfb0027607907a32f621f56e9407ccf2955407a966dca56ff1542a499baaa Jun 14 21:33:34.824479 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:33:34.824451 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996f5f9e_8ec3_4f0f_95a5_84b68d052d83.slice/crio-5eb4f401bb14eb533e252b1ca9088051f8c30771736c29b96db75039655be46e WatchSource:0}: Error finding container 5eb4f401bb14eb533e252b1ca9088051f8c30771736c29b96db75039655be46e: Status 404 returned error can't find the container with id 5eb4f401bb14eb533e252b1ca9088051f8c30771736c29b96db75039655be46e Jun 14 21:33:35.049043 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.048990 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 21:28:34 +0000 UTC" deadline="2028-02-24 22:40:14.728413636 +0000 UTC" Jun 14 21:33:35.049043 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.049040 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14881h6m39.679375808s" Jun 14 21:33:35.075493 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.075470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:35.075608 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.075590 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:35.083214 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.083185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"9421f9c9c73933219d0201c405faafc04d6fcc8f04d172f26c38a13b9057c4d9"} Jun 14 21:33:35.084255 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.084230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8zpj" event={"ID":"996f5f9e-8ec3-4f0f-95a5-84b68d052d83","Type":"ContainerStarted","Data":"5eb4f401bb14eb533e252b1ca9088051f8c30771736c29b96db75039655be46e"} Jun 14 21:33:35.090159 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.090130 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hqcn6" event={"ID":"02c515c5-0202-409c-9849-d94d4f44ef2a","Type":"ContainerStarted","Data":"243cfb0027607907a32f621f56e9407ccf2955407a966dca56ff1542a499baaa"} Jun 14 21:33:35.091229 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.091199 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerStarted","Data":"cc24ca86968df515ef1802b3fb122e7cb43d27ab096178736046a3bce5d924f8"} Jun 14 21:33:35.093087 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.093062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" event={"ID":"8ed6de627129f31f4d7226feeb6c47d8","Type":"ContainerStarted","Data":"d576ffcb001061ed47078f67d0d576c3aa5245d8748fb66a42fdef66387e5119"} Jun 14 21:33:35.094664 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.094641 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" event={"ID":"ceb1b81d7c3613bb64f8bbca4ea6dacb","Type":"ContainerStarted","Data":"155d1f8e52e73319df60116c076101035a93e3e369702c6d7cdc023a68b8d368"} Jun 14 21:33:35.095848 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.095828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" event={"ID":"15cb6195-96bd-4145-9d5e-381be5c30074","Type":"ContainerStarted","Data":"016d997f3ed30ea129b970c213f803632dea8db12b0c5950e76ed1391a221fb3"} Jun 14 21:33:35.097018 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.096997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4rtr" event={"ID":"957388b6-85fb-4539-ab38-a1c584af238a","Type":"ContainerStarted","Data":"138ab0f8f239cf1a551a1123fb94322e85c178b1fa7e3fc925b9e7a88187d560"} Jun 14 21:33:35.098115 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.098095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-57wst" event={"ID":"2240902e-c3a1-4417-a4c8-649a26984810","Type":"ContainerStarted","Data":"8b89fb77f4890587e489057f06c00eca38e553a873be99e030fc21e29f375f59"} Jun 14 21:33:35.099111 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.099082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" event={"ID":"b3fda755-d1ab-4e55-8e71-05bc2c883e8b","Type":"ContainerStarted","Data":"8b92a28583cbc8cf0366818b4592ded1a4f1b2bb66c1a9779749785d0e456557"} Jun 14 21:33:35.100076 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.100054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d5z8n" event={"ID":"2b3d6888-b153-4809-b707-ec7b852a8341","Type":"ContainerStarted","Data":"4cf8cbe1ac21219910f9b45272bf963b846cd43f8dca054f6ca6ed3c6599a681"} Jun 14 21:33:35.108386 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.108333 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-159.ec2.internal" podStartSLOduration=2.108321136 podStartE2EDuration="2.108321136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:35.107843339 +0000 UTC m=+3.458463209" watchObservedRunningTime="2026-06-14 21:33:35.108321136 +0000 UTC m=+3.458941006" Jun 14 21:33:35.736257 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.735560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:35.736257 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.735652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:35.736257 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:35.735686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:35.736257 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.735834 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:35.736257 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.735901 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret podName:b2267a16-a530-42bf-ae41-2f080b488a89 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:37.735881231 +0000 UTC m=+6.086501084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret") pod "global-pull-secret-syncer-s9fvf" (UID: "b2267a16-a530-42bf-ae41-2f080b488a89") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:35.736685 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.736294 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:35.736685 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.736353 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:37.736335672 +0000 UTC m=+6.086955524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:35.736685 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.736375 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:35.736685 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.736400 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:35.736685 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.736413 2562 projected.go:196] Error preparing data for projected volume kube-api-access-6ftf9 for pod openshift-network-diagnostics/network-check-target-48vvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:35.736685 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:35.736475 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9 podName:6e0afad5-f98e-4551-a1b3-9d59aee059e6 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:37.736458662 +0000 UTC m=+6.087078516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftf9" (UniqueName: "kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9") pod "network-check-target-48vvv" (UID: "6e0afad5-f98e-4551-a1b3-9d59aee059e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:36.049890 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:36.049757 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 21:28:34 +0000 UTC" deadline="2027-12-12 18:08:36.500836436 +0000 UTC" Jun 14 21:33:36.049890 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:36.049800 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13100h35m0.451041897s" Jun 14 21:33:36.087659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:36.086727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:36.087659 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:36.086932 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:36.087659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:36.087443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:36.087659 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:36.087559 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:36.116972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:36.116550 2562 generic.go:356] "Generic (PLEG): container finished" podID="ceb1b81d7c3613bb64f8bbca4ea6dacb" containerID="155d1f8e52e73319df60116c076101035a93e3e369702c6d7cdc023a68b8d368" exitCode=0 Jun 14 21:33:36.116972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:36.116608 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" event={"ID":"ceb1b81d7c3613bb64f8bbca4ea6dacb","Type":"ContainerDied","Data":"155d1f8e52e73319df60116c076101035a93e3e369702c6d7cdc023a68b8d368"} Jun 14 21:33:36.116972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:36.116677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" event={"ID":"ceb1b81d7c3613bb64f8bbca4ea6dacb","Type":"ContainerStarted","Data":"e16a75f91001ec129c8d6e2eb790c60695488a6132b14cc38d7b21b772194129"} Jun 14 21:33:37.075011 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:37.074975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:37.075561 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.075103 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:37.750830 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:37.750790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:37.751030 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:37.750848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:37.751030 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:37.750903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:37.751152 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751045 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:37.751152 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751113 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:41.751092888 +0000 UTC m=+10.101712762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:37.751913 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751536 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:37.751913 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751556 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:37.751913 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751585 2562 projected.go:196] Error preparing data for projected volume kube-api-access-6ftf9 for pod openshift-network-diagnostics/network-check-target-48vvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:37.751913 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751646 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9 podName:6e0afad5-f98e-4551-a1b3-9d59aee059e6 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:41.751630567 +0000 UTC m=+10.102250419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftf9" (UniqueName: "kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9") pod "network-check-target-48vvv" (UID: "6e0afad5-f98e-4551-a1b3-9d59aee059e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:37.751913 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751715 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:37.751913 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:37.751751 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret podName:b2267a16-a530-42bf-ae41-2f080b488a89 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:41.751739242 +0000 UTC m=+10.102359093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret") pod "global-pull-secret-syncer-s9fvf" (UID: "b2267a16-a530-42bf-ae41-2f080b488a89") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:38.076442 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:38.075670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:38.076442 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:38.075798 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:38.076442 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:38.076231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:38.076442 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:38.076344 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:39.075102 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:39.075066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:39.075289 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:39.075213 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:40.076000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:40.075386 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:40.076000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:40.075433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:40.076000 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:40.075553 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:40.076000 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:40.075962 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:41.075865 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:41.075735 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:41.076057 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.075869 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:41.785100 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:41.785009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:41.785100 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:41.785085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:41.785121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785150 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785224 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:49.785202356 +0000 UTC m=+18.135822222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785282 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785300 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785311 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785324 2562 projected.go:196] Error preparing data for projected volume kube-api-access-6ftf9 for pod openshift-network-diagnostics/network-check-target-48vvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:41.785346 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785354 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret podName:b2267a16-a530-42bf-ae41-2f080b488a89 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:49.785339114 +0000 UTC m=+18.135958983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret") pod "global-pull-secret-syncer-s9fvf" (UID: "b2267a16-a530-42bf-ae41-2f080b488a89") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:41.785780 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:41.785378 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9 podName:6e0afad5-f98e-4551-a1b3-9d59aee059e6 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:49.785361055 +0000 UTC m=+18.135980928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftf9" (UniqueName: "kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9") pod "network-check-target-48vvv" (UID: "6e0afad5-f98e-4551-a1b3-9d59aee059e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:42.075733 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:42.075624 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:42.076488 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:42.076463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:42.077011 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:42.076581 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:42.077011 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:42.076978 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:43.075647 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:43.075554 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:43.075814 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:43.075694 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:44.075321 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:44.074901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:44.075321 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:44.075031 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:44.075321 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:44.075042 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:44.075321 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:44.075174 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:45.075440 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:45.075400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:45.075939 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:45.075535 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:46.075333 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:46.075299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:46.075333 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:46.075327 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:46.075877 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:46.075439 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:46.075877 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:46.075561 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:47.075589 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:47.075543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:47.076080 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:47.075674 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:48.075696 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:48.075662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:48.076177 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:48.075676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:48.076177 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:48.075800 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:48.076177 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:48.075887 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:49.075601 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:49.075541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:49.075776 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.075709 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:49.844103 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:49.844061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:49.844103 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:49.844105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:49.844149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844229 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844230 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844232 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844292 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:05.844273034 +0000 UTC m=+34.194892887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844306 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844324 2562 projected.go:196] Error preparing data for projected volume kube-api-access-6ftf9 for pod openshift-network-diagnostics/network-check-target-48vvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:49.844339 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844310 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret podName:b2267a16-a530-42bf-ae41-2f080b488a89 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:05.844301719 +0000 UTC m=+34.194921568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret") pod "global-pull-secret-syncer-s9fvf" (UID: "b2267a16-a530-42bf-ae41-2f080b488a89") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:49.844741 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:49.844375 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9 podName:6e0afad5-f98e-4551-a1b3-9d59aee059e6 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:05.844360247 +0000 UTC m=+34.194980096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftf9" (UniqueName: "kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9") pod "network-check-target-48vvv" (UID: "6e0afad5-f98e-4551-a1b3-9d59aee059e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:50.078312 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:50.078286 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:50.078771 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:50.078415 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:50.078771 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:50.078482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:50.078771 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:50.078612 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:51.075766 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:51.075557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:51.075936 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:51.075861 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:52.078220 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:52.078193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:52.078220 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:52.078216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:52.078220 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:52.078217 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:52.078774 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:52.078302 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:52.078774 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:52.078391 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:52.078774 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:52.078460 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:54.078775 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.078600 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:54.079471 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.078675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:54.079471 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:54.078847 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:54.079471 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:54.078935 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:54.079471 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.078675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:54.079471 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:54.079013 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:54.170863 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.170819 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" event={"ID":"15cb6195-96bd-4145-9d5e-381be5c30074","Type":"ContainerStarted","Data":"46484a43011baea7a90160e621ab7880dcd57332afd43edd234cc86aed98be27"} Jun 14 21:33:54.172550 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.172517 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4rtr" event={"ID":"957388b6-85fb-4539-ab38-a1c584af238a","Type":"ContainerStarted","Data":"d1c5e2e12027df2b01865c169241752a9aec749a53946f71b50d0eb1a3de1673"} Jun 14 21:33:54.174185 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.174154 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" event={"ID":"b3fda755-d1ab-4e55-8e71-05bc2c883e8b","Type":"ContainerStarted","Data":"aafe642dfceea31e302696af46308b4a720624e58697bc92b95728de14224bd7"} Jun 14 21:33:54.175720 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.175692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d5z8n" event={"ID":"2b3d6888-b153-4809-b707-ec7b852a8341","Type":"ContainerStarted","Data":"7d72e0304cb708576590c0556d61eb81f58e175540c5e2409a4c1a7cc69936ea"} Jun 14 21:33:54.179087 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179065 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:33:54.179467 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179445 2562 generic.go:356] "Generic (PLEG): container finished" podID="8aeb0415-7757-4cb7-8c29-f641f9a46ead" containerID="ed7c9d2ef4bd169673920a401e68cb87bba268f9d39cc3212a3202f997ca3ca4" exitCode=1 Jun 14 21:33:54.179549 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"18dcabc87c93dd8238a7e2e1bbe119ca5d59a6582f91da6bef89046b82951ae3"} Jun 14 21:33:54.179632 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179608 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"9ae0dc6db33ca7c6a610235a563bc223be2ea0d43d99fbb2c4420de41ab0befe"} Jun 14 21:33:54.179689 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"38ca659e07efceaf66baa2838a232ae2f85ccf06935f9f48f542223d0041ad01"} Jun 14 21:33:54.179742 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"f65f748bfa370c0e2f8f6224d08438a03261dda4fe7a07796f7f95be4c230a39"} Jun 14 21:33:54.179794 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerDied","Data":"ed7c9d2ef4bd169673920a401e68cb87bba268f9d39cc3212a3202f997ca3ca4"} Jun 14 21:33:54.179847 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.179796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"d9f7da59b9c9e8a3380190d61f829b15f3db98bf0ccb1d5401692743b693ead1"} Jun 14 21:33:54.181116 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.181087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8zpj" event={"ID":"996f5f9e-8ec3-4f0f-95a5-84b68d052d83","Type":"ContainerStarted","Data":"7a88c18ec3a0b6c4c6cb992641e1db6e35ec40bbb618adc4e798dd0f6ad2e8f8"} Jun 14 21:33:54.182533 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.182509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hqcn6" event={"ID":"02c515c5-0202-409c-9849-d94d4f44ef2a","Type":"ContainerStarted","Data":"111756f3a4393b0308e4614964d78f509d4c41d9389b1f9d7a116069814b8942"} Jun 14 21:33:54.184136 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.184110 2562 generic.go:356] "Generic (PLEG): container finished" podID="2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5" containerID="5f7a477e8cebc033bc7698d22074e2facbc41894fe84098fe184c45132ec9296" exitCode=0 Jun 14 21:33:54.184245 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.184142 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerDied","Data":"5f7a477e8cebc033bc7698d22074e2facbc41894fe84098fe184c45132ec9296"} Jun 14 21:33:54.188516 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.188480 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-159.ec2.internal" podStartSLOduration=21.188450933 podStartE2EDuration="21.188450933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:36.131385387 +0000 UTC m=+4.482005259" watchObservedRunningTime="2026-06-14 21:33:54.188450933 +0000 UTC m=+22.539070798" Jun 14 21:33:54.188951 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.188921 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hxrgq" podStartSLOduration=3.890318788 podStartE2EDuration="22.188911814s" totalImagesPullingTime="18.298593026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:54.188775905 +0000 UTC m=+22.539395780" watchObservedRunningTime="2026-06-14 21:33:54.188911814 +0000 UTC m=+22.539531682" Jun 14 21:33:54.205083 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.205047 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g4rtr" podStartSLOduration=3.894610222 podStartE2EDuration="22.205026732s" totalImagesPullingTime="18.31041651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:54.204923439 +0000 UTC m=+22.555543312" watchObservedRunningTime="2026-06-14 21:33:54.205026732 +0000 UTC m=+22.555646604" Jun 14 21:33:54.240436 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.240387 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d5z8n" podStartSLOduration=3.941955748 podStartE2EDuration="22.240369845s" totalImagesPullingTime="18.298414097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:54.239895282 +0000 UTC m=+22.590515156" watchObservedRunningTime="2026-06-14 21:33:54.240369845 +0000 UTC m=+22.590989716" Jun 14 21:33:54.273253 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.273166 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f8zpj" podStartSLOduration=3.9987248380000002 podStartE2EDuration="22.273149142s" totalImagesPullingTime="18.274424304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:54.252775533 +0000 UTC m=+22.603395407" watchObservedRunningTime="2026-06-14 21:33:54.273149142 +0000 UTC m=+22.623769054" Jun 14 21:33:54.356520 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.356443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:54.431733 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.431704 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:54.581335 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.581178 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:54.681198 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.681166 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:54.690355 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:54.690334 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 21:33:55.077444 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.077334 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T21:33:54.690352411Z","UUID":"66935150-2794-4f27-80f1-adc581b7f02b","Handler":null,"Name":"","Endpoint":""} Jun 14 21:33:55.079119 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.079093 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 21:33:55.079528 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.079139 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 21:33:55.188910 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.188874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" event={"ID":"b3fda755-d1ab-4e55-8e71-05bc2c883e8b","Type":"ContainerStarted","Data":"1b97b5f96a8cc0516db9baf3cbd66e03e750fae416aa2f7a6876af171b6ad542"} Jun 14 21:33:55.190880 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.190844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-57wst" event={"ID":"2240902e-c3a1-4417-a4c8-649a26984810","Type":"ContainerStarted","Data":"21011db95bd32d533657a9c9cfab8bbb6e709ffb6ae1d2bfb7aaf9a1ac5fb0ec"} Jun 14 21:33:55.205376 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.205327 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-57wst" podStartSLOduration=4.902755847 podStartE2EDuration="23.205308447s" totalImagesPullingTime="18.3025526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:55.205006345 +0000 UTC m=+23.555626218" watchObservedRunningTime="2026-06-14 21:33:55.205308447 +0000 UTC m=+23.555928322" Jun 14 21:33:55.205517 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.205459 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hqcn6" podStartSLOduration=9.526355847 podStartE2EDuration="23.205450449s" totalImagesPullingTime="13.679094602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:54.272724529 +0000 UTC m=+22.623344401" watchObservedRunningTime="2026-06-14 21:33:55.205450449 +0000 UTC m=+23.556070337" Jun 14 21:33:55.322995 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.322958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:55.377779 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:55.377686 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:56.079375 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.079351 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:56.079375 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.079377 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:56.080235 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:56.079472 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:56.080235 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:56.079529 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:56.080235 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.079607 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:56.080235 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:56.079682 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:56.195887 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.195802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" event={"ID":"b3fda755-d1ab-4e55-8e71-05bc2c883e8b","Type":"ContainerStarted","Data":"c55aeb9fbcd03a89843e1b53d47feb44dfeb54f7a9e4135c50e4620a07761ee0"} Jun 14 21:33:56.199355 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.199326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:33:56.199772 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.199743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"455517ba63042ff10c41bbdeecbe14c8f70e0168c540c2866679b043e1b2ca20"} Jun 14 21:33:56.211221 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.211171 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gr8zh" podStartSLOduration=3.763271889 podStartE2EDuration="24.211151875s" totalImagesPullingTime="20.447879986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:56.211005657 +0000 UTC m=+24.561625530" watchObservedRunningTime="2026-06-14 21:33:56.211151875 +0000 UTC m=+24.561771749" Jun 14 21:33:56.415733 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.415696 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:56.416381 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.416361 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:56.848585 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.848540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:56.913479 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:56.913449 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:57.051260 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:57.051223 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:57.101399 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:57.101323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:57.202702 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:57.202669 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:57.203312 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:57.203289 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hqcn6" Jun 14 21:33:57.221619 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:57.221587 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:57.273489 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:57.273454 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:58.079078 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:58.079050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:33:58.079244 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:58.079061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:33:58.079244 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:58.079159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:33:58.079244 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:58.079159 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:33:58.079244 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:58.079225 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:33:58.079437 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:33:58.079294 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:33:59.210220 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.210047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:33:59.210781 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.210553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"b4726086203d307130d07a688dd857d377f80e278bb6dcfc3bacf85f27771496"} Jun 14 21:33:59.210827 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.210799 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:59.211021 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.211002 2562 scope.go:117] "RemoveContainer" containerID="ed7c9d2ef4bd169673920a401e68cb87bba268f9d39cc3212a3202f997ca3ca4" Jun 14 21:33:59.212591 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.212547 2562 generic.go:356] "Generic (PLEG): container finished" podID="2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5" containerID="4f65d6ff53d0f22a97db1a5d4b924d962aa53227e78a8bd50f17f0a107c4ac93" exitCode=0 Jun 14 21:33:59.212693 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.212648 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerDied","Data":"4f65d6ff53d0f22a97db1a5d4b924d962aa53227e78a8bd50f17f0a107c4ac93"} Jun 14 21:33:59.229208 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.229184 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:33:59.984878 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:33:59.984698 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:00.042718 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.042686 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:00.074917 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.074882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:34:00.074917 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.074910 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:00.075108 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.074882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:00.075108 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:00.074995 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:34:00.075108 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:00.075062 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:34:00.075285 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:00.075131 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:34:00.138265 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.138230 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9fvf"] Jun 14 21:34:00.140443 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.140406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48vvv"] Jun 14 21:34:00.149450 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.149426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qj4f9"] Jun 14 21:34:00.218410 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.218383 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:34:00.218957 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.218828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" event={"ID":"8aeb0415-7757-4cb7-8c29-f641f9a46ead","Type":"ContainerStarted","Data":"49f645978a23a3b0e5e29b65e5f723295e4a0f99dfb2fc9ae236e1e1ad4bb5e5"} Jun 14 21:34:00.219044 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.219027 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:34:00.219206 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.219177 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:34:00.221146 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.221123 2562 generic.go:356] "Generic (PLEG): container finished" podID="2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5" containerID="6bbbd8126c6cd51d4725524b05e7c09964c1b240eaeda87bc217f74b259091ff" exitCode=0 Jun 14 21:34:00.221259 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.221175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:34:00.221259 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.221214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerDied","Data":"6bbbd8126c6cd51d4725524b05e7c09964c1b240eaeda87bc217f74b259091ff"} Jun 14 21:34:00.221374 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:00.221268 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:34:00.221374 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.221347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:00.221462 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:00.221447 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:34:00.221507 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.221477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:00.221664 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:00.221622 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:34:00.235683 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.235662 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:34:00.244394 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.244339 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" podStartSLOduration=9.887345988 podStartE2EDuration="28.24432596s" totalImagesPullingTime="18.356979972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:00.243044489 +0000 UTC m=+28.593664360" watchObservedRunningTime="2026-06-14 21:34:00.24432596 +0000 UTC m=+28.594945822" Jun 14 21:34:00.767188 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.767152 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:00.867434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:00.867409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:01.227433 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:01.227402 2562 generic.go:356] "Generic (PLEG): container finished" podID="2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5" containerID="54f72611ffddb489f91782695a457b563a7506394bf84f7dfc621db52817c96b" exitCode=0 Jun 14 21:34:01.227907 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:01.227465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerDied","Data":"54f72611ffddb489f91782695a457b563a7506394bf84f7dfc621db52817c96b"} Jun 14 21:34:02.078632 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:02.078599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:02.078632 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:02.078630 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:02.078875 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:02.078601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:34:02.078875 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:02.078737 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:34:02.078979 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:02.078890 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:34:02.078979 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:02.078966 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:34:04.078641 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:04.078603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:34:04.078641 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:04.078642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:04.079406 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:04.078616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:04.079406 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:04.078736 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:34:04.079406 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:04.078836 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9fvf" podUID="b2267a16-a530-42bf-ae41-2f080b488a89" Jun 14 21:34:04.079406 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:04.078929 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48vvv" podUID="6e0afad5-f98e-4551-a1b3-9d59aee059e6" Jun 14 21:34:05.863194 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.863006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.863217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863170 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863277 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863292 2562 projected.go:196] Error preparing data for projected volume kube-api-access-6ftf9 for pod openshift-network-diagnostics/network-check-target-48vvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863325 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863328 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.863258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9 podName:6e0afad5-f98e-4551-a1b3-9d59aee059e6 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:37.863330916 +0000 UTC m=+66.213950783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6ftf9" (UniqueName: "kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9") pod "network-check-target-48vvv" (UID: "6e0afad5-f98e-4551-a1b3-9d59aee059e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863384 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret podName:b2267a16-a530-42bf-ae41-2f080b488a89 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:37.863368235 +0000 UTC m=+66.213988085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret") pod "global-pull-secret-syncer-s9fvf" (UID: "b2267a16-a530-42bf-ae41-2f080b488a89") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:34:05.863660 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:05.863404 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:37.863395248 +0000 UTC m=+66.214015097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:34:05.926870 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.926845 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-159.ec2.internal" event="NodeReady" Jun 14 21:34:05.926981 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.926967 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 21:34:05.974755 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.974651 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fnc7x"] Jun 14 21:34:05.995438 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.995411 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-prbbn"] Jun 14 21:34:05.995596 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.995540 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:05.997663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.997642 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 21:34:05.997874 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.997859 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 21:34:05.997966 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:05.997894 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dh44t\"" Jun 14 21:34:06.013751 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.013728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.013751 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.013745 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-prbbn"] Jun 14 21:34:06.013913 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.013784 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fnc7x"] Jun 14 21:34:06.015711 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.015692 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 21:34:06.015834 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.015815 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 21:34:06.015834 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.015829 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqfn9\"" Jun 14 21:34:06.015968 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.015840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 21:34:06.065584 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.065546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/598ed8ce-96cb-40c9-ad90-a0293cc67363-tmp-dir\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.065698 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.065594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/598ed8ce-96cb-40c9-ad90-a0293cc67363-config-volume\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.065698 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.065611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.065698 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.065668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cb8c\" (UniqueName: \"kubernetes.io/projected/598ed8ce-96cb-40c9-ad90-a0293cc67363-kube-api-access-5cb8c\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.075778 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.075755 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:06.075871 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.075849 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:06.076000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.075958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:34:06.078038 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.078021 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 21:34:06.078288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.078162 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 21:34:06.078288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.078227 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 21:34:06.078288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.078261 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zzhb8\"" Jun 14 21:34:06.078288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.078263 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 21:34:06.078515 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.078309 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v2f84\"" Jun 14 21:34:06.088289 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.088270 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:06.166322 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl7ql\" (UniqueName: \"kubernetes.io/projected/3248c498-13d0-4d68-b422-7d189af93401-kube-api-access-wl7ql\") pod \"ingress-canary-prbbn\" (UID: \"3248c498-13d0-4d68-b422-7d189af93401\") " pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.166322 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/598ed8ce-96cb-40c9-ad90-a0293cc67363-tmp-dir\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.166541 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/598ed8ce-96cb-40c9-ad90-a0293cc67363-config-volume\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.166541 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.166541 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cb8c\" (UniqueName: \"kubernetes.io/projected/598ed8ce-96cb-40c9-ad90-a0293cc67363-kube-api-access-5cb8c\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.166541 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166518 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3248c498-13d0-4d68-b422-7d189af93401-cert\") pod \"ingress-canary-prbbn\" (UID: \"3248c498-13d0-4d68-b422-7d189af93401\") " pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.166541 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:06.166478 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:06.166798 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:06.166619 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:06.666596702 +0000 UTC m=+35.017216567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:34:06.166798 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/598ed8ce-96cb-40c9-ad90-a0293cc67363-tmp-dir\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.166878 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.166863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/598ed8ce-96cb-40c9-ad90-a0293cc67363-config-volume\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.175984 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.175964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cb8c\" (UniqueName: \"kubernetes.io/projected/598ed8ce-96cb-40c9-ad90-a0293cc67363-kube-api-access-5cb8c\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.187447 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.187427 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:06.241761 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.241701 2562 generic.go:356] "Generic (PLEG): container finished" podID="2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5" containerID="06fb88f1a855f573f3097eee94e42c5919abe85582247d38fcd98617b575f3e5" exitCode=0 Jun 14 21:34:06.241856 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.241759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerDied","Data":"06fb88f1a855f573f3097eee94e42c5919abe85582247d38fcd98617b575f3e5"} Jun 14 21:34:06.267487 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.267463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl7ql\" (UniqueName: \"kubernetes.io/projected/3248c498-13d0-4d68-b422-7d189af93401-kube-api-access-wl7ql\") pod \"ingress-canary-prbbn\" (UID: \"3248c498-13d0-4d68-b422-7d189af93401\") " pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.267595 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.267517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3248c498-13d0-4d68-b422-7d189af93401-cert\") pod \"ingress-canary-prbbn\" (UID: \"3248c498-13d0-4d68-b422-7d189af93401\") " pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.269850 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.269832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3248c498-13d0-4d68-b422-7d189af93401-cert\") pod \"ingress-canary-prbbn\" (UID: \"3248c498-13d0-4d68-b422-7d189af93401\") " pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.274753 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.274734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl7ql\" (UniqueName: \"kubernetes.io/projected/3248c498-13d0-4d68-b422-7d189af93401-kube-api-access-wl7ql\") pod \"ingress-canary-prbbn\" (UID: \"3248c498-13d0-4d68-b422-7d189af93401\") " pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.321454 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.321433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-prbbn" Jun 14 21:34:06.497395 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.497300 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-prbbn"] Jun 14 21:34:06.501804 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:34:06.501780 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3248c498_13d0_4d68_b422_7d189af93401.slice/crio-3e10ec0411fc691b07d13175deb30f028b8426c6e5b582627d7373032197df25 WatchSource:0}: Error finding container 3e10ec0411fc691b07d13175deb30f028b8426c6e5b582627d7373032197df25: Status 404 returned error can't find the container with id 3e10ec0411fc691b07d13175deb30f028b8426c6e5b582627d7373032197df25 Jun 14 21:34:06.670454 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:06.670425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:06.670649 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:06.670539 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:06.670649 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:06.670604 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:07.670590624 +0000 UTC m=+36.021210473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:34:07.247730 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:07.247697 2562 generic.go:356] "Generic (PLEG): container finished" podID="2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5" containerID="a3d0ad3184d1968e20ae013012cf4b5c47bba02be8f0d6ca68437c127b6602eb" exitCode=0 Jun 14 21:34:07.248271 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:07.247785 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerDied","Data":"a3d0ad3184d1968e20ae013012cf4b5c47bba02be8f0d6ca68437c127b6602eb"} Jun 14 21:34:07.249484 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:07.248986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-prbbn" event={"ID":"3248c498-13d0-4d68-b422-7d189af93401","Type":"ContainerStarted","Data":"3e10ec0411fc691b07d13175deb30f028b8426c6e5b582627d7373032197df25"} Jun 14 21:34:07.677828 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:07.677646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:07.677828 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:07.677825 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:07.678035 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:07.677904 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:09.677882676 +0000 UTC m=+38.028502556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:34:08.254433 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:08.254402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" event={"ID":"2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5","Type":"ContainerStarted","Data":"ae36f05a841a5b6a33bd3637263acd5b88ae1f7932a04f7f021470934e9c17ca"} Jun 14 21:34:08.275402 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:08.275357 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f9jsc" podStartSLOduration=8.450671851 podStartE2EDuration="36.27534243s" totalImagesPullingTime="27.824670579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:08.274065468 +0000 UTC m=+36.624685338" watchObservedRunningTime="2026-06-14 21:34:08.27534243 +0000 UTC m=+36.625962301" Jun 14 21:34:08.396325 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:08.396296 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:08.449344 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:08.449314 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:09.258543 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:09.258503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-prbbn" event={"ID":"3248c498-13d0-4d68-b422-7d189af93401","Type":"ContainerStarted","Data":"91de11c70298740ccd29f03a0800cb59d410f0368817d60d264f2aab4ddbc557"} Jun 14 21:34:09.273130 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:09.273079 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-prbbn" podStartSLOduration=2.188105457 podStartE2EDuration="4.273063397s" totalImagesPullingTime="2.08495794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:09.272326472 +0000 UTC m=+37.622946344" watchObservedRunningTime="2026-06-14 21:34:09.273063397 +0000 UTC m=+37.623683604" Jun 14 21:34:09.693803 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:09.693778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:09.693974 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:09.693953 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:09.694046 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:09.694035 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:13.694013532 +0000 UTC m=+42.044633387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:34:11.622144 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:11.622107 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:11.669208 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:11.669173 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:13.723610 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:13.723562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:13.723944 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:13.723693 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:13.723944 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:13.723761 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:21.72374339 +0000 UTC m=+50.074363239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:34:18.016005 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:18.015976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:18.067332 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:18.067294 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:20.252490 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:20.252458 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:20.316014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:20.315977 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:20.386549 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:20.386513 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:21.782329 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:21.782292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:21.782755 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:21.782397 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:21.782755 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:21.782450 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:37.782434782 +0000 UTC m=+66.133054630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:34:32.241093 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:32.241063 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhvtv" Jun 14 21:34:32.345907 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:32.345870 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:32.399787 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:32.399753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:32.451615 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:32.451589 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:34:37.795244 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.795205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:34:37.795626 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:37.795366 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:37.795626 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:37.795436 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:35:09.795417033 +0000 UTC m=+98.146036883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:34:37.896485 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.896444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:37.896485 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.896488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:37.896800 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.896526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:34:37.899083 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.899065 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 21:34:37.899163 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.899116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 21:34:37.899163 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.899119 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 21:34:37.907716 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:37.907698 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 21:34:37.907794 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:34:37.907780 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:35:41.907758982 +0000 UTC m=+130.258378856 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : secret "metrics-daemon-secret" not found Jun 14 21:34:37.909470 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.909450 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 21:34:37.910953 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.910934 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2267a16-a530-42bf-ae41-2f080b488a89-original-pull-secret\") pod \"global-pull-secret-syncer-s9fvf\" (UID: \"b2267a16-a530-42bf-ae41-2f080b488a89\") " pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:37.919909 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:37.919887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ftf9\" (UniqueName: \"kubernetes.io/projected/6e0afad5-f98e-4551-a1b3-9d59aee059e6-kube-api-access-6ftf9\") pod \"network-check-target-48vvv\" (UID: \"6e0afad5-f98e-4551-a1b3-9d59aee059e6\") " pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:38.187482 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:38.187389 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zzhb8\"" Jun 14 21:34:38.190335 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:38.190298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9fvf" Jun 14 21:34:38.195470 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:38.195447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:38.369940 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:38.369905 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9fvf"] Jun 14 21:34:38.373270 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:34:38.373246 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2267a16_a530_42bf_ae41_2f080b488a89.slice/crio-e7a557686b029d50705e7e6377fcc092ccc11b2ac5fd82b3ad59664f9bdab794 WatchSource:0}: Error finding container e7a557686b029d50705e7e6377fcc092ccc11b2ac5fd82b3ad59664f9bdab794: Status 404 returned error can't find the container with id e7a557686b029d50705e7e6377fcc092ccc11b2ac5fd82b3ad59664f9bdab794 Jun 14 21:34:38.384240 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:38.384213 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48vvv"] Jun 14 21:34:38.387177 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:34:38.387153 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0afad5_f98e_4551_a1b3_9d59aee059e6.slice/crio-46eb824904762c78a8828302e4305ebbd543aa7080a7e5be0f349a6e8836a70d WatchSource:0}: Error finding container 46eb824904762c78a8828302e4305ebbd543aa7080a7e5be0f349a6e8836a70d: Status 404 returned error can't find the container with id 46eb824904762c78a8828302e4305ebbd543aa7080a7e5be0f349a6e8836a70d Jun 14 21:34:39.331515 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:39.331478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9fvf" event={"ID":"b2267a16-a530-42bf-ae41-2f080b488a89","Type":"ContainerStarted","Data":"e7a557686b029d50705e7e6377fcc092ccc11b2ac5fd82b3ad59664f9bdab794"} Jun 14 21:34:39.333840 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:39.333807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48vvv" event={"ID":"6e0afad5-f98e-4551-a1b3-9d59aee059e6","Type":"ContainerStarted","Data":"46eb824904762c78a8828302e4305ebbd543aa7080a7e5be0f349a6e8836a70d"} Jun 14 21:34:42.094635 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.094600 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5"] Jun 14 21:34:42.096705 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.096680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.099310 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.099285 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 14 21:34:42.099437 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.099288 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 21:34:42.100097 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.100073 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 21:34:42.100221 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.100115 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nbfbr\"" Jun 14 21:34:42.100221 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.100135 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 21:34:42.109097 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.109075 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5"] Jun 14 21:34:42.124663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.124642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm4gk\" (UniqueName: \"kubernetes.io/projected/e6bc1fd9-50a3-436d-84c9-9343a7326125-kube-api-access-lm4gk\") pod \"managed-serviceaccount-addon-agent-5df64bfb48-njgx5\" (UID: \"e6bc1fd9-50a3-436d-84c9-9343a7326125\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.124777 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.124687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6bc1fd9-50a3-436d-84c9-9343a7326125-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5df64bfb48-njgx5\" (UID: \"e6bc1fd9-50a3-436d-84c9-9343a7326125\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.225881 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.225844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6bc1fd9-50a3-436d-84c9-9343a7326125-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5df64bfb48-njgx5\" (UID: \"e6bc1fd9-50a3-436d-84c9-9343a7326125\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.226055 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.225917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm4gk\" (UniqueName: \"kubernetes.io/projected/e6bc1fd9-50a3-436d-84c9-9343a7326125-kube-api-access-lm4gk\") pod \"managed-serviceaccount-addon-agent-5df64bfb48-njgx5\" (UID: \"e6bc1fd9-50a3-436d-84c9-9343a7326125\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.228673 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.228648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6bc1fd9-50a3-436d-84c9-9343a7326125-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5df64bfb48-njgx5\" (UID: \"e6bc1fd9-50a3-436d-84c9-9343a7326125\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.234326 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.234300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm4gk\" (UniqueName: \"kubernetes.io/projected/e6bc1fd9-50a3-436d-84c9-9343a7326125-kube-api-access-lm4gk\") pod \"managed-serviceaccount-addon-agent-5df64bfb48-njgx5\" (UID: \"e6bc1fd9-50a3-436d-84c9-9343a7326125\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.416071 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.415991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" Jun 14 21:34:42.783506 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:42.783461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5"] Jun 14 21:34:42.787067 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:34:42.787040 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6bc1fd9_50a3_436d_84c9_9343a7326125.slice/crio-43e027cf6923a029f8331b3d8d0c22e48f20976bda57620b2ddf91ac1e796e43 WatchSource:0}: Error finding container 43e027cf6923a029f8331b3d8d0c22e48f20976bda57620b2ddf91ac1e796e43: Status 404 returned error can't find the container with id 43e027cf6923a029f8331b3d8d0c22e48f20976bda57620b2ddf91ac1e796e43 Jun 14 21:34:43.344935 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:43.344901 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" event={"ID":"e6bc1fd9-50a3-436d-84c9-9343a7326125","Type":"ContainerStarted","Data":"43e027cf6923a029f8331b3d8d0c22e48f20976bda57620b2ddf91ac1e796e43"} Jun 14 21:34:43.346325 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:43.346303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48vvv" event={"ID":"6e0afad5-f98e-4551-a1b3-9d59aee059e6","Type":"ContainerStarted","Data":"2a7f4cc345003f567764481b1dd2cfa1566d796aacaaa0223ffa07f38979bb72"} Jun 14 21:34:43.346450 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:43.346434 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:34:43.347796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:43.347778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9fvf" event={"ID":"b2267a16-a530-42bf-ae41-2f080b488a89","Type":"ContainerStarted","Data":"c12bb029d4a9d44dba6baa8241feab82b3318232590a1d0279f6fade6f861ce6"} Jun 14 21:34:43.361175 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:43.361133 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-48vvv" podStartSLOduration=67.093063412 podStartE2EDuration="1m11.361119823s" totalImagesPullingTime="4.268056411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:43.360669145 +0000 UTC m=+71.711289016" watchObservedRunningTime="2026-06-14 21:34:43.361119823 +0000 UTC m=+71.711739693" Jun 14 21:34:43.375884 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:43.375838 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s9fvf" podStartSLOduration=67.091237886 podStartE2EDuration="1m11.375822332s" totalImagesPullingTime="4.284584446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:43.37566642 +0000 UTC m=+71.726286292" watchObservedRunningTime="2026-06-14 21:34:43.375822332 +0000 UTC m=+71.726442203" Jun 14 21:34:45.353861 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:45.353826 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" event={"ID":"e6bc1fd9-50a3-436d-84c9-9343a7326125","Type":"ContainerStarted","Data":"ac89a9a5b24f523e80b8fc0e5b9b1364f808661a75ac0745d1292b2f54caaae3"} Jun 14 21:34:45.372697 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:34:45.372648 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" podStartSLOduration=0.983664522 podStartE2EDuration="3.372630468s" totalImagesPullingTime="2.388965946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:45.3718437 +0000 UTC m=+73.722463573" watchObservedRunningTime="2026-06-14 21:34:45.372630468 +0000 UTC m=+73.723250338" Jun 14 21:35:09.824147 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:35:09.824095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:35:09.824545 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:35:09.824254 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:35:09.824545 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:35:09.824323 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:36:13.824306053 +0000 UTC m=+162.174925902 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:35:14.352870 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:35:14.352838 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-48vvv" Jun 14 21:35:41.937287 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:35:41.937231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:35:41.937751 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:35:41.937391 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 21:35:41.937751 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:35:41.937460 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs podName:35a7518d-ac6d-4a64-96dd-bdeaff580470 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:43.93744242 +0000 UTC m=+252.288062269 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs") pod "network-metrics-daemon-qj4f9" (UID: "35a7518d-ac6d-4a64-96dd-bdeaff580470") : secret "metrics-daemon-secret" not found Jun 14 21:36:09.004798 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:36:09.004726 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fnc7x" podUID="598ed8ce-96cb-40c9-ad90-a0293cc67363" Jun 14 21:36:09.095406 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:36:09.095366 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qj4f9" podUID="35a7518d-ac6d-4a64-96dd-bdeaff580470" Jun 14 21:36:09.555629 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:09.555599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fnc7x" Jun 14 21:36:13.856706 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:13.856660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:36:13.857115 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:36:13.856792 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:36:13.857115 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:36:13.856857 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls podName:598ed8ce-96cb-40c9-ad90-a0293cc67363 nodeName:}" failed. No retries permitted until 2026-06-14 21:38:15.856842969 +0000 UTC m=+284.207462818 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls") pod "dns-default-fnc7x" (UID: "598ed8ce-96cb-40c9-ad90-a0293cc67363") : secret "dns-default-metrics-tls" not found Jun 14 21:36:24.075107 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:24.075027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:36:39.615363 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:39.615327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:36:45.646549 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:45.646467 2562 generic.go:356] "Generic (PLEG): container finished" podID="e6bc1fd9-50a3-436d-84c9-9343a7326125" containerID="ac89a9a5b24f523e80b8fc0e5b9b1364f808661a75ac0745d1292b2f54caaae3" exitCode=255 Jun 14 21:36:45.646549 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:45.646516 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" event={"ID":"e6bc1fd9-50a3-436d-84c9-9343a7326125","Type":"ContainerDied","Data":"ac89a9a5b24f523e80b8fc0e5b9b1364f808661a75ac0745d1292b2f54caaae3"} Jun 14 21:36:45.652039 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:45.652018 2562 scope.go:117] "RemoveContainer" containerID="ac89a9a5b24f523e80b8fc0e5b9b1364f808661a75ac0745d1292b2f54caaae3" Jun 14 21:36:46.651452 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:36:46.651419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df64bfb48-njgx5" event={"ID":"e6bc1fd9-50a3-436d-84c9-9343a7326125","Type":"ContainerStarted","Data":"e11fb8836cfb85d4b92bb382f6dca1e13ab3b06bef74f24e79c6dc5bd40da5ba"} Jun 14 21:37:07.035118 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.035084 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d86b4776d-qj94x"] Jun 14 21:37:07.036773 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.036757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.039275 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.039253 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 14 21:37:07.039533 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.039501 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 14 21:37:07.039626 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.039538 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 14 21:37:07.039782 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.039766 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 21:37:07.040121 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.040099 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-clwx7\"" Jun 14 21:37:07.040121 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.040112 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 14 21:37:07.040121 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.040116 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 21:37:07.062963 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.062937 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d86b4776d-qj94x"] Jun 14 21:37:07.117128 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.117099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.117128 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.117131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-default-certificate\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.117345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.117152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.117345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.117173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwr6t\" (UniqueName: \"kubernetes.io/projected/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-kube-api-access-bwr6t\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.117345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.117222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-stats-auth\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.127743 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.127711 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8"] Jun 14 21:37:07.129363 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.129341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.130649 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.130630 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv"] Jun 14 21:37:07.131663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.131640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 21:37:07.131773 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.131649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-scb49\"" Jun 14 21:37:07.131773 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.131672 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 21:37:07.131773 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.131663 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 21:37:07.132073 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.132059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.133043 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.133026 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 21:37:07.134038 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.134019 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 14 21:37:07.134272 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.134252 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 14 21:37:07.134428 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.134034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rxpb7\"" Jun 14 21:37:07.134637 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.134621 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 14 21:37:07.134851 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.134693 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 14 21:37:07.134998 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.134982 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-zhwlj"] Jun 14 21:37:07.136669 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.136500 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c5fd8dcdc-mcqbs"] Jun 14 21:37:07.136669 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.136640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:07.138533 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.138512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.139005 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.138984 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 14 21:37:07.139087 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.139018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gmfhs\"" Jun 14 21:37:07.139140 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.139125 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 14 21:37:07.141256 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.141242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 21:37:07.142706 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.142690 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n55vx\"" Jun 14 21:37:07.142785 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.142742 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 21:37:07.142912 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.142873 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 21:37:07.148709 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.148687 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8"] Jun 14 21:37:07.149587 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.149549 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 21:37:07.149997 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.149977 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv"] Jun 14 21:37:07.150727 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.150707 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-zhwlj"] Jun 14 21:37:07.154648 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.154623 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5fd8dcdc-mcqbs"] Jun 14 21:37:07.218055 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fecedc-aee2-425e-b06e-0c4aa490e673-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.218211 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9gns\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-kube-api-access-k9gns\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218211 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-stats-auth\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.218211 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:07.218211 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-registry-certificates\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218211 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhrtq\" (UniqueName: \"kubernetes.io/projected/5419fc9c-4dab-4b61-895d-4b402a659438-kube-api-access-fhrtq\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-installation-pull-secrets\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acd5474b-d699-4157-a759-3948e91c4a11-ca-trust-extracted\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwr6t\" (UniqueName: \"kubernetes.io/projected/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-kube-api-access-bwr6t\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.218340 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-image-registry-private-configuration\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.218394 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:07.718378103 +0000 UTC m=+216.068997952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : secret "router-metrics-certs-default" not found Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fecedc-aee2-425e-b06e-0c4aa490e673-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.218483 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7hh\" (UniqueName: \"kubernetes.io/projected/d7fecedc-aee2-425e-b06e-0c4aa490e673-kube-api-access-lk7hh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95afa596-dedc-439e-9805-2dc4fae1bfed-nginx-conf\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5419fc9c-4dab-4b61-895d-4b402a659438-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-trusted-ca\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-default-certificate\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-bound-sa-token\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.218831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.218748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.219062 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.218860 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:07.718849029 +0000 UTC m=+216.069468881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : configmap references non-existent config key: service-ca.crt Jun 14 21:37:07.220740 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.220721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-stats-auth\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.220858 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.220844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-default-certificate\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.230187 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.230159 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwr6t\" (UniqueName: \"kubernetes.io/projected/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-kube-api-access-bwr6t\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.293879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.293819 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:07.319940 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.319920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5419fc9c-4dab-4b61-895d-4b402a659438-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.320035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.319947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.319966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-trusted-ca\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.319992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-bound-sa-token\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fecedc-aee2-425e-b06e-0c4aa490e673-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.320179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9gns\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-kube-api-access-k9gns\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:07.320179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-registry-certificates\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhrtq\" (UniqueName: \"kubernetes.io/projected/5419fc9c-4dab-4b61-895d-4b402a659438-kube-api-access-fhrtq\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-installation-pull-secrets\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acd5474b-d699-4157-a759-3948e91c4a11-ca-trust-extracted\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-image-registry-private-configuration\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fecedc-aee2-425e-b06e-0c4aa490e673-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7hh\" (UniqueName: \"kubernetes.io/projected/d7fecedc-aee2-425e-b06e-0c4aa490e673-kube-api-access-lk7hh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.320426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95afa596-dedc-439e-9805-2dc4fae1bfed-nginx-conf\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:07.320524 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.320407 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 21:37:07.320907 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.320599 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 21:37:07.320907 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.320628 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert podName:95afa596-dedc-439e-9805-2dc4fae1bfed nodeName:}" failed. No retries permitted until 2026-06-14 21:37:07.820603769 +0000 UTC m=+216.171223622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-zhwlj" (UID: "95afa596-dedc-439e-9805-2dc4fae1bfed") : secret "networking-console-plugin-cert" not found Jun 14 21:37:07.320907 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.320690 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5fd8dcdc-mcqbs: secret "image-registry-tls" not found Jun 14 21:37:07.321189 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.321041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fecedc-aee2-425e-b06e-0c4aa490e673-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.321330 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.321312 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls podName:acd5474b-d699-4157-a759-3948e91c4a11 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:07.821285646 +0000 UTC m=+216.171905510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls") pod "image-registry-c5fd8dcdc-mcqbs" (UID: "acd5474b-d699-4157-a759-3948e91c4a11") : secret "image-registry-tls" not found Jun 14 21:37:07.321394 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.321359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5419fc9c-4dab-4b61-895d-4b402a659438-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.321463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.321440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acd5474b-d699-4157-a759-3948e91c4a11-ca-trust-extracted\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.321515 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.321460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-registry-certificates\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.321627 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.321608 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:07.322377 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.322355 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls podName:5419fc9c-4dab-4b61-895d-4b402a659438 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:07.822334783 +0000 UTC m=+216.172954644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-n5tm8" (UID: "5419fc9c-4dab-4b61-895d-4b402a659438") : secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:07.323005 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.322945 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-trusted-ca\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.323319 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.323289 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95afa596-dedc-439e-9805-2dc4fae1bfed-nginx-conf\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:07.323862 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.323840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fecedc-aee2-425e-b06e-0c4aa490e673-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.324299 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.324253 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-installation-pull-secrets\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.324299 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.324263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-image-registry-private-configuration\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.329058 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.329032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7hh\" (UniqueName: \"kubernetes.io/projected/d7fecedc-aee2-425e-b06e-0c4aa490e673-kube-api-access-lk7hh\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7bkfv\" (UID: \"d7fecedc-aee2-425e-b06e-0c4aa490e673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.329240 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.329216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9gns\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-kube-api-access-k9gns\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.329488 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.329467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhrtq\" (UniqueName: \"kubernetes.io/projected/5419fc9c-4dab-4b61-895d-4b402a659438-kube-api-access-fhrtq\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.329785 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.329769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-bound-sa-token\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.395003 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.394978 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:07.446201 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.446167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" Jun 14 21:37:07.565356 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.565278 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv"] Jun 14 21:37:07.568324 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:07.568286 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fecedc_aee2_425e_b06e_0c4aa490e673.slice/crio-ceeba0e739e7466012bc34cc88c815447168e984effc4e0d56eab763713d7f28 WatchSource:0}: Error finding container ceeba0e739e7466012bc34cc88c815447168e984effc4e0d56eab763713d7f28: Status 404 returned error can't find the container with id ceeba0e739e7466012bc34cc88c815447168e984effc4e0d56eab763713d7f28 Jun 14 21:37:07.715821 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.715785 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" event={"ID":"d7fecedc-aee2-425e-b06e-0c4aa490e673","Type":"ContainerStarted","Data":"ceeba0e739e7466012bc34cc88c815447168e984effc4e0d56eab763713d7f28"} Jun 14 21:37:07.723111 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.723089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.723185 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.723142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:07.723259 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.723245 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:08.723226774 +0000 UTC m=+217.073846622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : configmap references non-existent config key: service-ca.crt Jun 14 21:37:07.723299 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.723271 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 21:37:07.723337 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.723316 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:08.723301796 +0000 UTC m=+217.073921647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : secret "router-metrics-certs-default" not found Jun 14 21:37:07.824161 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.824065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:07.824161 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.824129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:07.824350 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:07.824183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:07.824350 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.824217 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 21:37:07.824350 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.824237 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5fd8dcdc-mcqbs: secret "image-registry-tls" not found Jun 14 21:37:07.824350 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.824267 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:07.824350 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.824292 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls podName:acd5474b-d699-4157-a759-3948e91c4a11 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:08.824275837 +0000 UTC m=+217.174895689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls") pod "image-registry-c5fd8dcdc-mcqbs" (UID: "acd5474b-d699-4157-a759-3948e91c4a11") : secret "image-registry-tls" not found Jun 14 21:37:07.824350 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.824329 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls podName:5419fc9c-4dab-4b61-895d-4b402a659438 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:08.824309089 +0000 UTC m=+217.174928947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-n5tm8" (UID: "5419fc9c-4dab-4b61-895d-4b402a659438") : secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:07.824350 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.824268 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 21:37:07.824595 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:07.824359 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert podName:95afa596-dedc-439e-9805-2dc4fae1bfed nodeName:}" failed. No retries permitted until 2026-06-14 21:37:08.824352854 +0000 UTC m=+217.174972703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-zhwlj" (UID: "95afa596-dedc-439e-9805-2dc4fae1bfed") : secret "networking-console-plugin-cert" not found Jun 14 21:37:08.732622 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:08.732592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:08.733024 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:08.732710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:08.733024 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.732750 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 21:37:08.733024 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.732827 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:10.732807305 +0000 UTC m=+219.083427177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : secret "router-metrics-certs-default" not found Jun 14 21:37:08.733024 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.732845 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:10.73283387 +0000 UTC m=+219.083453727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : configmap references non-existent config key: service-ca.crt Jun 14 21:37:08.833349 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:08.833315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:08.833505 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:08.833407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:08.833505 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.833466 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:08.833505 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:08.833489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:08.833670 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.833533 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls podName:5419fc9c-4dab-4b61-895d-4b402a659438 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:10.833513517 +0000 UTC m=+219.184133387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-n5tm8" (UID: "5419fc9c-4dab-4b61-895d-4b402a659438") : secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:08.833670 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.833586 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 21:37:08.833670 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.833596 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 21:37:08.833670 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.833620 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5fd8dcdc-mcqbs: secret "image-registry-tls" not found Jun 14 21:37:08.833670 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.833629 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert podName:95afa596-dedc-439e-9805-2dc4fae1bfed nodeName:}" failed. No retries permitted until 2026-06-14 21:37:10.833617636 +0000 UTC m=+219.184237485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-zhwlj" (UID: "95afa596-dedc-439e-9805-2dc4fae1bfed") : secret "networking-console-plugin-cert" not found Jun 14 21:37:08.833670 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:08.833673 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls podName:acd5474b-d699-4157-a759-3948e91c4a11 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:10.833655863 +0000 UTC m=+219.184275716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls") pod "image-registry-c5fd8dcdc-mcqbs" (UID: "acd5474b-d699-4157-a759-3948e91c4a11") : secret "image-registry-tls" not found Jun 14 21:37:09.723610 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:09.723557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" event={"ID":"d7fecedc-aee2-425e-b06e-0c4aa490e673","Type":"ContainerStarted","Data":"83949dc5ee22be63f1dc25745fa457c1596cdced5272e8449d79257f223e1b9c"} Jun 14 21:37:09.738410 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:09.738362 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" podStartSLOduration=1.055607382 podStartE2EDuration="2.738347207s" totalImagesPullingTime="1.682739825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:09.737290025 +0000 UTC m=+218.087909912" watchObservedRunningTime="2026-06-14 21:37:09.738347207 +0000 UTC m=+218.088967078" Jun 14 21:37:10.387950 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.387909 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:10.416384 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.416351 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7"] Jun 14 21:37:10.418364 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.418343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" Jun 14 21:37:10.420760 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.420733 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z944s\"" Jun 14 21:37:10.420852 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.420780 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 14 21:37:10.420852 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.420739 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 14 21:37:10.428479 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.428444 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7"] Jun 14 21:37:10.448397 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.448362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2b56\" (UniqueName: \"kubernetes.io/projected/d9edfbfa-c100-4890-8c54-cf51647bffb8-kube-api-access-m2b56\") pod \"migrator-d4bcd4867-2drt7\" (UID: \"d9edfbfa-c100-4890-8c54-cf51647bffb8\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" Jun 14 21:37:10.459260 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.459234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:10.508350 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.508308 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:10.549543 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.549514 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2b56\" (UniqueName: \"kubernetes.io/projected/d9edfbfa-c100-4890-8c54-cf51647bffb8-kube-api-access-m2b56\") pod \"migrator-d4bcd4867-2drt7\" (UID: \"d9edfbfa-c100-4890-8c54-cf51647bffb8\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" Jun 14 21:37:10.557149 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.557121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2b56\" (UniqueName: \"kubernetes.io/projected/d9edfbfa-c100-4890-8c54-cf51647bffb8-kube-api-access-m2b56\") pod \"migrator-d4bcd4867-2drt7\" (UID: \"d9edfbfa-c100-4890-8c54-cf51647bffb8\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" Jun 14 21:37:10.727090 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.727008 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" Jun 14 21:37:10.751973 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.751944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:10.752293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.752009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:10.752293 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.752111 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:14.752095299 +0000 UTC m=+223.102715153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : configmap references non-existent config key: service-ca.crt Jun 14 21:37:10.752293 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.752150 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 21:37:10.752293 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.752218 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:14.752199774 +0000 UTC m=+223.102819640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : secret "router-metrics-certs-default" not found Jun 14 21:37:10.852677 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.852639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:10.852854 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.852749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:10.852854 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.852825 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 21:37:10.852854 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.852848 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5fd8dcdc-mcqbs: secret "image-registry-tls" not found Jun 14 21:37:10.853014 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.852864 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 21:37:10.853014 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.852917 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls podName:acd5474b-d699-4157-a759-3948e91c4a11 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:14.852891127 +0000 UTC m=+223.203510978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls") pod "image-registry-c5fd8dcdc-mcqbs" (UID: "acd5474b-d699-4157-a759-3948e91c4a11") : secret "image-registry-tls" not found Jun 14 21:37:10.853014 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.852935 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert podName:95afa596-dedc-439e-9805-2dc4fae1bfed nodeName:}" failed. No retries permitted until 2026-06-14 21:37:14.85292634 +0000 UTC m=+223.203546196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-zhwlj" (UID: "95afa596-dedc-439e-9805-2dc4fae1bfed") : secret "networking-console-plugin-cert" not found Jun 14 21:37:10.853014 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.852942 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:10.853014 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:10.852990 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls podName:5419fc9c-4dab-4b61-895d-4b402a659438 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:14.852973982 +0000 UTC m=+223.203593832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-n5tm8" (UID: "5419fc9c-4dab-4b61-895d-4b402a659438") : secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:10.853014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.852866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:10.853538 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:10.853518 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7"] Jun 14 21:37:10.856165 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:10.856144 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9edfbfa_c100_4890_8c54_cf51647bffb8.slice/crio-3a60c2c38f0db4c32f1e784a5631530b0b805f33ccb0c3e806e53b46da138e05 WatchSource:0}: Error finding container 3a60c2c38f0db4c32f1e784a5631530b0b805f33ccb0c3e806e53b46da138e05: Status 404 returned error can't find the container with id 3a60c2c38f0db4c32f1e784a5631530b0b805f33ccb0c3e806e53b46da138e05 Jun 14 21:37:11.463774 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.463727 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:11.520538 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.520505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:11.736043 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.735953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" event={"ID":"d9edfbfa-c100-4890-8c54-cf51647bffb8","Type":"ContainerStarted","Data":"3a60c2c38f0db4c32f1e784a5631530b0b805f33ccb0c3e806e53b46da138e05"} Jun 14 21:37:11.800562 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.800521 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jwpnx"] Jun 14 21:37:11.802772 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.802750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.804780 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.804753 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 21:37:11.804780 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.804762 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 21:37:11.804974 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.804794 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 21:37:11.804974 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.804919 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 21:37:11.805749 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.805728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tgr2l\"" Jun 14 21:37:11.813330 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.813298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jwpnx"] Jun 14 21:37:11.832640 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.832594 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:11.863270 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.863240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd7pn\" (UniqueName: \"kubernetes.io/projected/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-api-access-fd7pn\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.863438 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.863293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3955e897-d4a6-42d9-b970-8795b502ce6f-crio-socket\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.863438 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.863397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3955e897-d4a6-42d9-b970-8795b502ce6f-data-volume\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.863438 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.863432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.863608 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.863509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.886766 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.886720 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:11.964676 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.964635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3955e897-d4a6-42d9-b970-8795b502ce6f-crio-socket\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.964841 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.964706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3955e897-d4a6-42d9-b970-8795b502ce6f-data-volume\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.964841 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.964733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.964841 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.964777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3955e897-d4a6-42d9-b970-8795b502ce6f-crio-socket\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.964841 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.964798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.965031 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.964885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd7pn\" (UniqueName: \"kubernetes.io/projected/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-api-access-fd7pn\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.965031 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:11.964889 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:11.965031 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:11.964934 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:11.965031 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:11.964986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:12.464965114 +0000 UTC m=+220.815584982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:11.965031 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:11.965005 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:12.464996344 +0000 UTC m=+220.815616194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : configmap "kube-rbac-proxy" not found Jun 14 21:37:11.965277 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.965124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3955e897-d4a6-42d9-b970-8795b502ce6f-data-volume\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:11.973781 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:11.973753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd7pn\" (UniqueName: \"kubernetes.io/projected/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-api-access-fd7pn\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:12.405523 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.405492 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:12.454967 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.454933 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:12.470342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.470314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:12.470495 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.470418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:12.470495 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:12.470425 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:12.470495 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:12.470479 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:13.470464462 +0000 UTC m=+221.821084320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : configmap "kube-rbac-proxy" not found Jun 14 21:37:12.470624 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:12.470520 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:12.470624 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:12.470557 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:13.470545847 +0000 UTC m=+221.821165695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:12.740389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.740286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" event={"ID":"d9edfbfa-c100-4890-8c54-cf51647bffb8","Type":"ContainerStarted","Data":"b166dd9165cedfb1f0a773fd425b73f4655b20d27288c9cfe4e32c57643910a2"} Jun 14 21:37:12.740389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.740358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" event={"ID":"d9edfbfa-c100-4890-8c54-cf51647bffb8","Type":"ContainerStarted","Data":"3ff20d7ee89f8721df0e25d7085627e2e6015e1f22bde1687c2726ad4fed8adc"} Jun 14 21:37:12.754784 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.754731 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-2drt7" podStartSLOduration=1.59733694 podStartE2EDuration="2.754712528s" totalImagesPullingTime="1.157375588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:12.754275475 +0000 UTC m=+221.104895339" watchObservedRunningTime="2026-06-14 21:37:12.754712528 +0000 UTC m=+221.105332400" Jun 14 21:37:12.896933 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.896896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:12.950205 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:12.950171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:13.108457 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:13.108422 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:13.209465 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:13.209430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:13.479117 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:13.479023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:13.479117 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:13.479085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:13.479309 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:13.479156 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:13.479309 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:13.479185 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:13.479309 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:13.479203 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:15.479190615 +0000 UTC m=+223.829810464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : configmap "kube-rbac-proxy" not found Jun 14 21:37:13.479309 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:13.479239 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:15.479226506 +0000 UTC m=+223.829846355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:14.392846 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.392818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8zpj_996f5f9e-8ec3-4f0f-95a5-84b68d052d83/dns-node-resolver/0.log" Jun 14 21:37:14.735303 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.735225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:14.785205 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.785180 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:14.792126 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.792103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:14.792210 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.792188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:14.792260 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.792246 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 21:37:14.792309 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.792299 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:22.792285387 +0000 UTC m=+231.142905235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : secret "router-metrics-certs-default" not found Jun 14 21:37:14.792393 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.792315 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle podName:c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:22.792308578 +0000 UTC m=+231.142928427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle") pod "router-default-6d86b4776d-qj94x" (UID: "c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7") : configmap references non-existent config key: service-ca.crt Jun 14 21:37:14.893474 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.893446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:14.893606 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.893496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:14.893606 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.893594 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 21:37:14.893679 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.893595 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 21:37:14.893679 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.893647 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5fd8dcdc-mcqbs: secret "image-registry-tls" not found Jun 14 21:37:14.893679 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.893648 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert podName:95afa596-dedc-439e-9805-2dc4fae1bfed nodeName:}" failed. No retries permitted until 2026-06-14 21:37:22.893633418 +0000 UTC m=+231.244253289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-zhwlj" (UID: "95afa596-dedc-439e-9805-2dc4fae1bfed") : secret "networking-console-plugin-cert" not found Jun 14 21:37:14.893777 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.893694 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls podName:acd5474b-d699-4157-a759-3948e91c4a11 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:22.893681816 +0000 UTC m=+231.244301665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls") pod "image-registry-c5fd8dcdc-mcqbs" (UID: "acd5474b-d699-4157-a759-3948e91c4a11") : secret "image-registry-tls" not found Jun 14 21:37:14.893777 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:14.893736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:14.893841 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.893800 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:14.893880 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:14.893875 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls podName:5419fc9c-4dab-4b61-895d-4b402a659438 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:22.89385962 +0000 UTC m=+231.244479470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-n5tm8" (UID: "5419fc9c-4dab-4b61-895d-4b402a659438") : secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:15.393077 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:15.393047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d5z8n_2b3d6888-b153-4809-b707-ec7b852a8341/node-ca/0.log" Jun 14 21:37:15.498155 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:15.498125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:15.498304 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:15.498222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:15.498304 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:15.498243 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:15.498375 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:15.498303 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:19.498288744 +0000 UTC m=+227.848908592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : configmap "kube-rbac-proxy" not found Jun 14 21:37:15.498375 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:15.498319 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:15.498375 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:15.498357 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:19.498344323 +0000 UTC m=+227.848964172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:15.630250 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:15.630220 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:16.326195 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:16.326163 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:16.396105 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:16.396080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-prbbn_3248c498-13d0-4d68-b422-7d189af93401/serve-healthcheck-canary/0.log" Jun 14 21:37:16.595896 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:16.595804 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:16.697121 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:16.697090 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:16.763785 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:16.763753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:16.795369 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:16.795337 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-2drt7_d9edfbfa-c100-4890-8c54-cf51647bffb8/migrator/0.log" Jun 14 21:37:16.992748 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:16.992676 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-2drt7_d9edfbfa-c100-4890-8c54-cf51647bffb8/graceful-termination/0.log" Jun 14 21:37:17.194469 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:17.194432 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7bkfv_d7fecedc-aee2-425e-b06e-0c4aa490e673/kube-storage-version-migrator-operator/0.log" Jun 14 21:37:17.423270 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:17.423234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:17.828324 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:17.828294 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:18.207307 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:18.207225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:18.270545 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:18.270508 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:18.426471 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:18.426427 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:19.016756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:19.016721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:19.418942 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:19.418849 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:19.531943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:19.531909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:19.532308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:19.531964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:19.532308 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:19.532069 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:19.532308 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:19.532071 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:19.532308 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:19.532124 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:27.532110061 +0000 UTC m=+235.882729910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : configmap "kube-rbac-proxy" not found Jun 14 21:37:19.532308 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:19.532137 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls podName:3955e897-d4a6-42d9-b970-8795b502ce6f nodeName:}" failed. No retries permitted until 2026-06-14 21:37:27.532131038 +0000 UTC m=+235.882750887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jwpnx" (UID: "3955e897-d4a6-42d9-b970-8795b502ce6f") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:19.821156 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:19.821123 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:20.223085 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:20.223009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:20.271997 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:20.271962 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:20.432649 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:20.432607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:20.832905 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:20.832869 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:21.421783 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:21.421748 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:21.555900 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:21.555872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:22.028649 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.028612 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:22.225687 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.225650 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:22.426053 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.425953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:22.623731 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.623695 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:22.814509 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.814473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:22.858465 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.858442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:22.858623 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.858551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:22.859135 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.859111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-service-ca-bundle\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:22.860765 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.860747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7-metrics-certs\") pod \"router-default-6d86b4776d-qj94x\" (UID: \"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7\") " pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:22.945038 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.944998 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:22.959265 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.959242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:22.959389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.959307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:22.959453 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.959396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:22.959453 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:22.959421 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 21:37:22.959553 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:22.959490 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert podName:95afa596-dedc-439e-9805-2dc4fae1bfed nodeName:}" failed. No retries permitted until 2026-06-14 21:37:38.959469086 +0000 UTC m=+247.310088937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-zhwlj" (UID: "95afa596-dedc-439e-9805-2dc4fae1bfed") : secret "networking-console-plugin-cert" not found Jun 14 21:37:22.959553 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:22.959527 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:22.959696 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:22.959598 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls podName:5419fc9c-4dab-4b61-895d-4b402a659438 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:38.959564745 +0000 UTC m=+247.310184599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-n5tm8" (UID: "5419fc9c-4dab-4b61-895d-4b402a659438") : secret "cluster-monitoring-operator-tls" not found Jun 14 21:37:22.961828 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:22.961806 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"image-registry-c5fd8dcdc-mcqbs\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:23.060960 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.060933 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:23.068897 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.068836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d86b4776d-qj94x"] Jun 14 21:37:23.073686 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:23.073657 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b8d7dc_6c01_4d51_966a_c1fdf0c360b7.slice/crio-1101e8dcdbb64f9a45c6978c5040f5312d411201ac65ded5ffee7cd1710a5e6a WatchSource:0}: Error finding container 1101e8dcdbb64f9a45c6978c5040f5312d411201ac65ded5ffee7cd1710a5e6a: Status 404 returned error can't find the container with id 1101e8dcdbb64f9a45c6978c5040f5312d411201ac65ded5ffee7cd1710a5e6a Jun 14 21:37:23.192397 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.192351 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5fd8dcdc-mcqbs"] Jun 14 21:37:23.195692 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:23.195667 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd5474b_d699_4157_a759_3948e91c4a11.slice/crio-6e7e9f6b03b2ec07cd6187a80792a264cc889791e83ad3fbe53f600904000679 WatchSource:0}: Error finding container 6e7e9f6b03b2ec07cd6187a80792a264cc889791e83ad3fbe53f600904000679: Status 404 returned error can't find the container with id 6e7e9f6b03b2ec07cd6187a80792a264cc889791e83ad3fbe53f600904000679 Jun 14 21:37:23.496879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.496797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:23.617639 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.617598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:23.772735 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.772703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d86b4776d-qj94x" event={"ID":"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7","Type":"ContainerStarted","Data":"b0fb724a1c9f5f3ae87d8eb1abb5541678d97177e947513fd322aeaa65a9d573"} Jun 14 21:37:23.772935 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.772756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d86b4776d-qj94x" event={"ID":"c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7","Type":"ContainerStarted","Data":"1101e8dcdbb64f9a45c6978c5040f5312d411201ac65ded5ffee7cd1710a5e6a"} Jun 14 21:37:23.774229 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.774199 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" event={"ID":"acd5474b-d699-4157-a759-3948e91c4a11","Type":"ContainerStarted","Data":"93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb"} Jun 14 21:37:23.774320 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.774246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" event={"ID":"acd5474b-d699-4157-a759-3948e91c4a11","Type":"ContainerStarted","Data":"6e7e9f6b03b2ec07cd6187a80792a264cc889791e83ad3fbe53f600904000679"} Jun 14 21:37:23.774320 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.774301 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:23.790005 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.789965 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d86b4776d-qj94x" podStartSLOduration=16.78995086 podStartE2EDuration="16.78995086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:23.788888569 +0000 UTC m=+232.139508439" watchObservedRunningTime="2026-06-14 21:37:23.78995086 +0000 UTC m=+232.140570731" Jun 14 21:37:23.807900 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.807861 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" podStartSLOduration=16.807848039 podStartE2EDuration="16.807848039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:23.806744508 +0000 UTC m=+232.157364381" watchObservedRunningTime="2026-06-14 21:37:23.807848039 +0000 UTC m=+232.158467910" Jun 14 21:37:23.945764 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.945721 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:23.948149 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:23.948124 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:24.018685 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:24.018637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:24.220596 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:24.220480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:24.418454 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:24.418420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:24.616858 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:24.616814 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:24.777633 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:24.777600 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:24.778762 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:24.778741 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d86b4776d-qj94x" Jun 14 21:37:25.421204 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:25.421167 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:25.620594 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:25.620536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:26.215737 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:26.215704 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:26.615491 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:26.615459 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:26.819826 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:26.819792 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:27.017402 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:27.017375 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:27.599055 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:27.599012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:27.599213 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:27.599119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:27.599592 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:27.599543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3955e897-d4a6-42d9-b970-8795b502ce6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:27.601345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:27.601319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3955e897-d4a6-42d9-b970-8795b502ce6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jwpnx\" (UID: \"3955e897-d4a6-42d9-b970-8795b502ce6f\") " pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:27.715191 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:27.715159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jwpnx" Jun 14 21:37:27.841922 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:27.841891 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jwpnx"] Jun 14 21:37:27.844755 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:27.844734 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3955e897_d4a6_42d9_b970_8795b502ce6f.slice/crio-f0274327b770ba4806097c2849a78c542c5f20243e89f7d5a5f87b5b3c05f306 WatchSource:0}: Error finding container f0274327b770ba4806097c2849a78c542c5f20243e89f7d5a5f87b5b3c05f306: Status 404 returned error can't find the container with id f0274327b770ba4806097c2849a78c542c5f20243e89f7d5a5f87b5b3c05f306 Jun 14 21:37:28.792221 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:28.792173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwpnx" event={"ID":"3955e897-d4a6-42d9-b970-8795b502ce6f","Type":"ContainerStarted","Data":"f0274327b770ba4806097c2849a78c542c5f20243e89f7d5a5f87b5b3c05f306"} Jun 14 21:37:29.716599 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:29.716544 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:29.817912 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:29.817824 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:29.867411 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:29.867364 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:30.007875 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:30.007721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:30.203176 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:30.203138 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:30.252235 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:30.252201 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:30.622187 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:30.622153 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:30.673545 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:30.673510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:30.762990 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:30.762955 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:30.863474 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:30.863436 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:31.029112 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:31.029064 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:31.086034 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:31.085995 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:31.400373 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:31.400350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:31.600767 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:31.600728 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:31.659947 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:31.659850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:31.804813 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:31.804783 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwpnx" event={"ID":"3955e897-d4a6-42d9-b970-8795b502ce6f","Type":"ContainerStarted","Data":"ca408f63bda5e5c31c6d39df346af243085ce36bd4713d7966a5c62527be0975"} Jun 14 21:37:32.810805 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:32.810766 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwpnx" event={"ID":"3955e897-d4a6-42d9-b970-8795b502ce6f","Type":"ContainerStarted","Data":"22442a2b43d093c82ed29d661dae374063984aa5cf21f80270763857c1f48e7a"} Jun 14 21:37:32.987948 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:32.987847 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c5fd8dcdc-mcqbs"] Jun 14 21:37:33.119127 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.118985 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:33.185475 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.185440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:33.562985 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.562947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:33.664845 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.664817 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:33.812270 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.812234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:33.815845 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.815775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jwpnx" event={"ID":"3955e897-d4a6-42d9-b970-8795b502ce6f","Type":"ContainerStarted","Data":"a9674d9875fc5c91637d6231269126e4ad9cce4d9500c898e9e15f026d174585"} Jun 14 21:37:33.834271 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.834225 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jwpnx" podStartSLOduration=17.202058799 podStartE2EDuration="22.83420967s" totalImagesPullingTime="5.632150871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:37:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:33.83353776 +0000 UTC m=+242.184157642" watchObservedRunningTime="2026-06-14 21:37:33.83420967 +0000 UTC m=+242.184829542" Jun 14 21:37:33.946098 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:33.946061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:34.003488 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:34.003458 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:38.998058 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:38.998018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:38.998473 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:38.998096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:39.000533 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.000514 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95afa596-dedc-439e-9805-2dc4fae1bfed-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-zhwlj\" (UID: \"95afa596-dedc-439e-9805-2dc4fae1bfed\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:39.000608 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.000538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5419fc9c-4dab-4b61-895d-4b402a659438-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-n5tm8\" (UID: \"5419fc9c-4dab-4b61-895d-4b402a659438\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:39.242240 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.242213 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-scb49\"" Jun 14 21:37:39.250904 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.250823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" Jun 14 21:37:39.257606 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.257565 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gmfhs\"" Jun 14 21:37:39.266404 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.266377 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" Jun 14 21:37:39.385944 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.385872 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8"] Jun 14 21:37:39.388749 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:39.388712 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5419fc9c_4dab_4b61_895d_4b402a659438.slice/crio-8d94e219fe6fb2feafc839b62c1156b418257d3f5ea1356181eed0e10f0ddfe4 WatchSource:0}: Error finding container 8d94e219fe6fb2feafc839b62c1156b418257d3f5ea1356181eed0e10f0ddfe4: Status 404 returned error can't find the container with id 8d94e219fe6fb2feafc839b62c1156b418257d3f5ea1356181eed0e10f0ddfe4 Jun 14 21:37:39.404698 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.404671 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-zhwlj"] Jun 14 21:37:39.407888 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:39.407866 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95afa596_dedc_439e_9805_2dc4fae1bfed.slice/crio-798a28c6da22c2a663b6263a8ca67bfd4bcc83f4efd52db3deede066c4760599 WatchSource:0}: Error finding container 798a28c6da22c2a663b6263a8ca67bfd4bcc83f4efd52db3deede066c4760599: Status 404 returned error can't find the container with id 798a28c6da22c2a663b6263a8ca67bfd4bcc83f4efd52db3deede066c4760599 Jun 14 21:37:39.833644 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.833603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" event={"ID":"95afa596-dedc-439e-9805-2dc4fae1bfed","Type":"ContainerStarted","Data":"798a28c6da22c2a663b6263a8ca67bfd4bcc83f4efd52db3deede066c4760599"} Jun 14 21:37:39.834678 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:39.834652 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" event={"ID":"5419fc9c-4dab-4b61-895d-4b402a659438","Type":"ContainerStarted","Data":"8d94e219fe6fb2feafc839b62c1156b418257d3f5ea1356181eed0e10f0ddfe4"} Jun 14 21:37:41.357475 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.357386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:41.458079 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.458042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:41.519398 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.519366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:41.842959 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.842918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" event={"ID":"95afa596-dedc-439e-9805-2dc4fae1bfed","Type":"ContainerStarted","Data":"7249fe7dfbeb6ce251d2c1cbcde6ee9e78db3079804597514df8606afce649b7"} Jun 14 21:37:41.844365 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.844336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" event={"ID":"5419fc9c-4dab-4b61-895d-4b402a659438","Type":"ContainerStarted","Data":"253dd421e6f3b95c7dc7613113fa77a54ac88cb1dd05c06791f6c72d438e8bf0"} Jun 14 21:37:41.856918 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.856874 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-zhwlj" podStartSLOduration=33.230515245 podStartE2EDuration="34.856859146s" totalImagesPullingTime="1.626343901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:41.856043347 +0000 UTC m=+250.206663217" watchObservedRunningTime="2026-06-14 21:37:41.856859146 +0000 UTC m=+250.207479018" Jun 14 21:37:41.870463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.870052 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-n5tm8" podStartSLOduration=33.218563043 podStartE2EDuration="34.870036489s" totalImagesPullingTime="1.651473446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:41.870009716 +0000 UTC m=+250.220629588" watchObservedRunningTime="2026-06-14 21:37:41.870036489 +0000 UTC m=+250.220656360" Jun 14 21:37:41.960325 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:41.960289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:42.027207 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:42.027167 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:42.994465 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:42.994423 2562 patch_prober.go:28] interesting pod/image-registry-c5fd8dcdc-mcqbs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:37:42.995020 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:42.994491 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" podUID="acd5474b-d699-4157-a759-3948e91c4a11" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:37:42.995020 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:42.994943 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:44.036960 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:44.036911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:37:44.039209 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:44.039190 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35a7518d-ac6d-4a64-96dd-bdeaff580470-metrics-certs\") pod \"network-metrics-daemon-qj4f9\" (UID: \"35a7518d-ac6d-4a64-96dd-bdeaff580470\") " pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:37:44.178979 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:44.178950 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v2f84\"" Jun 14 21:37:44.186313 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:44.186292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj4f9" Jun 14 21:37:44.311563 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:44.311488 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qj4f9"] Jun 14 21:37:44.314669 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:44.314638 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a7518d_ac6d_4a64_96dd_bdeaff580470.slice/crio-10cc17433923f33ff4cff359af16ced017b281d7e1ff6275808cf492bd49f241 WatchSource:0}: Error finding container 10cc17433923f33ff4cff359af16ced017b281d7e1ff6275808cf492bd49f241: Status 404 returned error can't find the container with id 10cc17433923f33ff4cff359af16ced017b281d7e1ff6275808cf492bd49f241 Jun 14 21:37:44.855057 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:44.855017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qj4f9" event={"ID":"35a7518d-ac6d-4a64-96dd-bdeaff580470","Type":"ContainerStarted","Data":"10cc17433923f33ff4cff359af16ced017b281d7e1ff6275808cf492bd49f241"} Jun 14 21:37:45.859293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:45.859254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qj4f9" event={"ID":"35a7518d-ac6d-4a64-96dd-bdeaff580470","Type":"ContainerStarted","Data":"83b60c6be5e2384ce3d2417421e0340baba21ef4b92661ecaaf82b4eed1c555c"} Jun 14 21:37:45.860394 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:45.860364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qj4f9" event={"ID":"35a7518d-ac6d-4a64-96dd-bdeaff580470","Type":"ContainerStarted","Data":"6dc943544f3a9b6e0daad6a83fb1d6e55ee4da8a4e0537f41f8d78ffd89f50f4"} Jun 14 21:37:45.874655 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:45.874610 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qj4f9" podStartSLOduration=253.039611173 podStartE2EDuration="4m13.874597797s" totalImagesPullingTime="834.986624ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:45.874350724 +0000 UTC m=+254.224970594" watchObservedRunningTime="2026-06-14 21:37:45.874597797 +0000 UTC m=+254.225217680" Jun 14 21:37:45.953866 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:45.953836 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:46.009851 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:46.009811 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:46.423820 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:46.423786 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:46.478491 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:46.478455 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:49.819385 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.819353 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bb7f7cff-jt2pm"] Jun 14 21:37:49.822433 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.822417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.824684 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.824653 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 21:37:49.824806 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.824780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 21:37:49.825647 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.825624 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 21:37:49.825647 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.825624 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 21:37:49.825871 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.825855 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vrx6q\"" Jun 14 21:37:49.826030 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.826008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 21:37:49.826086 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.826052 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 21:37:49.826147 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.826127 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 21:37:49.830191 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.830162 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 21:37:49.832850 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.832793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb7f7cff-jt2pm"] Jun 14 21:37:49.882713 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.882687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-trusted-ca-bundle\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.882883 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.882739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-oauth-config\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.882883 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.882763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-service-ca\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.882883 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.882807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-config\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.883000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.882881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-serving-cert\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.883000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.882908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-oauth-serving-cert\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.883000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.882930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6nw9\" (UniqueName: \"kubernetes.io/projected/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-kube-api-access-p6nw9\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.983244 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.983202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-trusted-ca-bundle\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.983395 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.983268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-oauth-config\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.983395 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.983290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-service-ca\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.983395 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.983313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-config\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.983395 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.983343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-serving-cert\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.983554 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.983458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-oauth-serving-cert\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.983554 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.983506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6nw9\" (UniqueName: \"kubernetes.io/projected/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-kube-api-access-p6nw9\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.984135 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.984107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-config\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.984240 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.984169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-oauth-serving-cert\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.984240 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.984210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-service-ca\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.984358 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.984340 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-trusted-ca-bundle\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.985911 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.985895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-oauth-config\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.985963 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.985921 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-serving-cert\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:49.990794 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:49.990772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6nw9\" (UniqueName: \"kubernetes.io/projected/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-kube-api-access-p6nw9\") pod \"console-5bb7f7cff-jt2pm\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:50.132659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:50.132557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:37:50.257293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:50.257259 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bb7f7cff-jt2pm"] Jun 14 21:37:50.260717 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:37:50.260690 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90604c2_d283_4d1b_a8c2_dd6cb7d51739.slice/crio-377fddfc9b1f6b7d708377baeb9fccc72292f7a8a6f262c9ad886c326a5bad9b WatchSource:0}: Error finding container 377fddfc9b1f6b7d708377baeb9fccc72292f7a8a6f262c9ad886c326a5bad9b: Status 404 returned error can't find the container with id 377fddfc9b1f6b7d708377baeb9fccc72292f7a8a6f262c9ad886c326a5bad9b Jun 14 21:37:50.427614 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:50.427499 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:50.875373 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:50.875336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb7f7cff-jt2pm" event={"ID":"f90604c2-d283-4d1b-a8c2-dd6cb7d51739","Type":"ContainerStarted","Data":"377fddfc9b1f6b7d708377baeb9fccc72292f7a8a6f262c9ad886c326a5bad9b"} Jun 14 21:37:52.884491 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:52.884448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb7f7cff-jt2pm" event={"ID":"f90604c2-d283-4d1b-a8c2-dd6cb7d51739","Type":"ContainerStarted","Data":"fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63"} Jun 14 21:37:52.900779 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:52.900726 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bb7f7cff-jt2pm" podStartSLOduration=1.387959304 podStartE2EDuration="3.90070773s" totalImagesPullingTime="2.512748426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:52.898771889 +0000 UTC m=+261.249391772" watchObservedRunningTime="2026-06-14 21:37:52.90070773 +0000 UTC m=+261.251327651" Jun 14 21:37:52.993052 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:52.993015 2562 patch_prober.go:28] interesting pod/image-registry-c5fd8dcdc-mcqbs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:37:52.993241 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:52.993075 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" podUID="acd5474b-d699-4157-a759-3948e91c4a11" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:37:53.551679 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:53.551645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:53.649616 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:53.649561 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:54.101552 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:54.101520 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:54.162081 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:54.162043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:54.555255 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:54.555213 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:57.765482 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:57.765451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:58.009139 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.009100 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" podUID="acd5474b-d699-4157-a759-3948e91c4a11" containerName="registry" containerID="cri-o://93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb" gracePeriod=30 Jun 14 21:37:58.031332 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.031292 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:58.087464 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.087432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:58.244013 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.243984 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:58.352681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352563 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-trusted-ca\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.352681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352633 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-bound-sa-token\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.352681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352656 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-registry-certificates\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.352681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352683 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-installation-pull-secrets\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.352996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-image-registry-private-configuration\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.352996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352727 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9gns\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-kube-api-access-k9gns\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.352996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352751 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.352996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.352810 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acd5474b-d699-4157-a759-3948e91c4a11-ca-trust-extracted\") pod \"acd5474b-d699-4157-a759-3948e91c4a11\" (UID: \"acd5474b-d699-4157-a759-3948e91c4a11\") " Jun 14 21:37:58.353213 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.353182 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 21:37:58.353300 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.353276 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 21:37:58.355166 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.355137 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:37:58.355312 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.355161 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-kube-api-access-k9gns" (OuterVolumeSpecName: "kube-api-access-k9gns") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "kube-api-access-k9gns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:37:58.355372 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.355318 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 21:37:58.355644 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.355534 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 21:37:58.355644 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.355637 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:37:58.361217 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.361194 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd5474b-d699-4157-a759-3948e91c4a11-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "acd5474b-d699-4157-a759-3948e91c4a11" (UID: "acd5474b-d699-4157-a759-3948e91c4a11"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 21:37:58.454288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454250 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acd5474b-d699-4157-a759-3948e91c4a11-ca-trust-extracted\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.454288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454281 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-trusted-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.454288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454291 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-bound-sa-token\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.454288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454300 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acd5474b-d699-4157-a759-3948e91c4a11-registry-certificates\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.454535 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454309 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-installation-pull-secrets\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.454535 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454319 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acd5474b-d699-4157-a759-3948e91c4a11-image-registry-private-configuration\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.454535 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454328 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9gns\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-kube-api-access-k9gns\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.454535 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.454336 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acd5474b-d699-4157-a759-3948e91c4a11-registry-tls\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:37:58.752633 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.752528 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:37:58.905880 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.905849 2562 generic.go:356] "Generic (PLEG): container finished" podID="acd5474b-d699-4157-a759-3948e91c4a11" containerID="93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb" exitCode=0 Jun 14 21:37:58.906226 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.905898 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" Jun 14 21:37:58.906226 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.905920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" event={"ID":"acd5474b-d699-4157-a759-3948e91c4a11","Type":"ContainerDied","Data":"93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb"} Jun 14 21:37:58.906226 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.905989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5fd8dcdc-mcqbs" event={"ID":"acd5474b-d699-4157-a759-3948e91c4a11","Type":"ContainerDied","Data":"6e7e9f6b03b2ec07cd6187a80792a264cc889791e83ad3fbe53f600904000679"} Jun 14 21:37:58.906226 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.906010 2562 scope.go:117] "RemoveContainer" containerID="93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb" Jun 14 21:37:58.914426 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.914406 2562 scope.go:117] "RemoveContainer" containerID="93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb" Jun 14 21:37:58.914719 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:37:58.914686 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb\": container with ID starting with 93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb not found: ID does not exist" containerID="93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb" Jun 14 21:37:58.914777 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.914727 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb"} err="failed to get container status \"93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb\": rpc error: code = NotFound desc = could not find container \"93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb\": container with ID starting with 93e6ff2de8ea203a256c31a047bff582f0281688192636302954abe2b96089eb not found: ID does not exist" Jun 14 21:37:58.925075 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.925053 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c5fd8dcdc-mcqbs"] Jun 14 21:37:58.927263 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:37:58.927240 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c5fd8dcdc-mcqbs"] Jun 14 21:38:00.079059 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.079026 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd5474b-d699-4157-a759-3948e91c4a11" path="/var/lib/kubelet/pods/acd5474b-d699-4157-a759-3948e91c4a11/volumes" Jun 14 21:38:00.132922 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.132890 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:38:00.133067 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.132945 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:38:00.134391 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.134368 2562 patch_prober.go:28] interesting pod/console-5bb7f7cff-jt2pm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 14 21:38:00.134499 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.134418 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bb7f7cff-jt2pm" podUID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 14 21:38:00.689035 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.688999 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:00.914979 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.914939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:00.938760 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.938731 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b"] Jun 14 21:38:00.938969 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.938958 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd5474b-d699-4157-a759-3948e91c4a11" containerName="registry" Jun 14 21:38:00.939006 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.938970 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd5474b-d699-4157-a759-3948e91c4a11" containerName="registry" Jun 14 21:38:00.939063 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.939012 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd5474b-d699-4157-a759-3948e91c4a11" containerName="registry" Jun 14 21:38:00.943980 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.943959 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:00.944170 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.944150 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v4qxv"] Jun 14 21:38:00.946050 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.946031 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 14 21:38:00.946142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.946065 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 14 21:38:00.946884 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.946866 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-c4ww6\"" Jun 14 21:38:00.946970 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.946887 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 21:38:00.947303 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.947285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:00.949377 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.949335 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 21:38:00.949516 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.949395 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5qb4h\"" Jun 14 21:38:00.949625 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.949613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 21:38:00.949697 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.949646 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 21:38:00.951603 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.951566 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b"] Jun 14 21:38:00.987711 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:00.987679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.061276 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.061243 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.071097 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071071 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-tls\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071190 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98sr\" (UniqueName: \"kubernetes.io/projected/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-kube-api-access-p98sr\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071190 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-wtmp\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071190 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-accelerators-collector-config\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071287 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071287 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-metrics-client-ca\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071350 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.071350 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.071350 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071329 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-sys\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071445 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-textfile\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071445 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-root\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.071445 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlt4g\" (UniqueName: \"kubernetes.io/projected/3fc353a6-ada2-43eb-8978-cf83e914e60f-kube-api-access-zlt4g\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.071445 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.071407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc353a6-ada2-43eb-8978-cf83e914e60f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.172739 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.172711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-sys\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.172747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-textfile\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.172822 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-sys\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.172867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-root\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.172902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlt4g\" (UniqueName: \"kubernetes.io/projected/3fc353a6-ada2-43eb-8978-cf83e914e60f-kube-api-access-zlt4g\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.172931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc353a6-ada2-43eb-8978-cf83e914e60f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.172970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-root\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-tls\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-textfile\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p98sr\" (UniqueName: \"kubernetes.io/projected/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-kube-api-access-p98sr\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-wtmp\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-accelerators-collector-config\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-metrics-client-ca\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-wtmp\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:01.173463 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 14 21:38:01.173607 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:01.173539 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-tls podName:3fc353a6-ada2-43eb-8978-cf83e914e60f nodeName:}" failed. No retries permitted until 2026-06-14 21:38:01.673520337 +0000 UTC m=+270.024140201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-bc44b" (UID: "3fc353a6-ada2-43eb-8978-cf83e914e60f") : secret "openshift-state-metrics-tls" not found Jun 14 21:38:01.174019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fc353a6-ada2-43eb-8978-cf83e914e60f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.174019 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:01.173746 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 21:38:01.174019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-accelerators-collector-config\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.174019 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:01.173890 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-tls podName:d002fcf6-741f-4f2f-b1e1-94ebd57c2427 nodeName:}" failed. No retries permitted until 2026-06-14 21:38:01.673868096 +0000 UTC m=+270.024487948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-tls") pod "node-exporter-v4qxv" (UID: "d002fcf6-741f-4f2f-b1e1-94ebd57c2427") : secret "node-exporter-tls" not found Jun 14 21:38:01.174019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.173927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-metrics-client-ca\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.175786 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.175766 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.175938 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.175920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.183674 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.183645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlt4g\" (UniqueName: \"kubernetes.io/projected/3fc353a6-ada2-43eb-8978-cf83e914e60f-kube-api-access-zlt4g\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.183775 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.183674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98sr\" (UniqueName: \"kubernetes.io/projected/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-kube-api-access-p98sr\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.195972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.195903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.296604 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.296557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.398086 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.398053 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.498246 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.498158 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.598665 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.598629 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.678915 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.678882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-tls\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.679072 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.678955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.681295 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.681269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d002fcf6-741f-4f2f-b1e1-94ebd57c2427-node-exporter-tls\") pod \"node-exporter-v4qxv\" (UID: \"d002fcf6-741f-4f2f-b1e1-94ebd57c2427\") " pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.681434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.681339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fc353a6-ada2-43eb-8978-cf83e914e60f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bc44b\" (UID: \"3fc353a6-ada2-43eb-8978-cf83e914e60f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.854699 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.854663 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" Jun 14 21:38:01.860042 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.860013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v4qxv" Jun 14 21:38:01.871827 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:38:01.871792 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd002fcf6_741f_4f2f_b1e1_94ebd57c2427.slice/crio-b9be8d2b16fd91c90f19f12ba17dc7fa28c9643fe8c52411080fc46f55261643 WatchSource:0}: Error finding container b9be8d2b16fd91c90f19f12ba17dc7fa28c9643fe8c52411080fc46f55261643: Status 404 returned error can't find the container with id b9be8d2b16fd91c90f19f12ba17dc7fa28c9643fe8c52411080fc46f55261643 Jun 14 21:38:01.920225 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.920185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4qxv" event={"ID":"d002fcf6-741f-4f2f-b1e1-94ebd57c2427","Type":"ContainerStarted","Data":"b9be8d2b16fd91c90f19f12ba17dc7fa28c9643fe8c52411080fc46f55261643"} Jun 14 21:38:01.926368 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.926335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:01.995013 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:01.994975 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b"] Jun 14 21:38:01.998839 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:38:01.998800 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc353a6_ada2_43eb_8978_cf83e914e60f.slice/crio-e5e47982b22fbb11968147160ca3c45f9a99e74271e8c995d2478111f8c03174 WatchSource:0}: Error finding container e5e47982b22fbb11968147160ca3c45f9a99e74271e8c995d2478111f8c03174: Status 404 returned error can't find the container with id e5e47982b22fbb11968147160ca3c45f9a99e74271e8c995d2478111f8c03174 Jun 14 21:38:02.005248 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.005218 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:02.006131 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.006112 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 21:38:02.009528 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.009512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.011513 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.011496 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 21:38:02.012434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012287 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 21:38:02.012434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 21:38:02.012434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 21:38:02.012434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012357 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6nlms\"" Jun 14 21:38:02.012434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012291 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 21:38:02.012434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012347 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 21:38:02.012757 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012535 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 21:38:02.012823 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012807 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 21:38:02.012874 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.012841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 21:38:02.027420 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.027399 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 21:38:02.082045 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082143 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082143 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082143 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082317 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-config-volume\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082317 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49f95ec2-35c1-48d9-8571-aaf574092eaf-config-out\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082317 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-web-config\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082317 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082565 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082565 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5b6g\" (UniqueName: \"kubernetes.io/projected/49f95ec2-35c1-48d9-8571-aaf574092eaf-kube-api-access-k5b6g\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082565 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082565 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49f95ec2-35c1-48d9-8571-aaf574092eaf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.082565 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.082484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.183768 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.183726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.183768 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.183768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-config-volume\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.184247 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.183799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49f95ec2-35c1-48d9-8571-aaf574092eaf-config-out\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.184247 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.183830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-web-config\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.184247 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.183859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.184247 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:02.183896 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-trusted-ca-bundle podName:49f95ec2-35c1-48d9-8571-aaf574092eaf nodeName:}" failed. No retries permitted until 2026-06-14 21:38:02.683868789 +0000 UTC m=+271.034488641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "49f95ec2-35c1-48d9-8571-aaf574092eaf") : configmap references non-existent config key: ca-bundle.crt Jun 14 21:38:02.186505 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5b6g\" (UniqueName: \"kubernetes.io/projected/49f95ec2-35c1-48d9-8571-aaf574092eaf-kube-api-access-k5b6g\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49f95ec2-35c1-48d9-8571-aaf574092eaf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186663 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186942 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186942 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186942 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.186758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.186942 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:02.186842 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 14 21:38:02.186942 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:02.186890 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-main-tls podName:49f95ec2-35c1-48d9-8571-aaf574092eaf nodeName:}" failed. No retries permitted until 2026-06-14 21:38:02.686874873 +0000 UTC m=+271.037494739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "49f95ec2-35c1-48d9-8571-aaf574092eaf") : secret "alertmanager-main-tls" not found Jun 14 21:38:02.187212 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.187140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.187474 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.187384 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-web-config\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.187474 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.187432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49f95ec2-35c1-48d9-8571-aaf574092eaf-config-out\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.188041 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.187785 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-config-volume\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.188184 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.188162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.189484 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.189453 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.189695 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.189678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.190324 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.190302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.190385 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.190353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49f95ec2-35c1-48d9-8571-aaf574092eaf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.211627 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.211600 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5b6g\" (UniqueName: \"kubernetes.io/projected/49f95ec2-35c1-48d9-8571-aaf574092eaf-kube-api-access-k5b6g\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.326251 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.326215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:02.691738 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.691700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.691912 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.691758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.692677 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.692648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f95ec2-35c1-48d9-8571-aaf574092eaf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.694702 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.694662 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49f95ec2-35c1-48d9-8571-aaf574092eaf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49f95ec2-35c1-48d9-8571-aaf574092eaf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.919906 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.919873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 21:38:02.927086 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.927058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" event={"ID":"3fc353a6-ada2-43eb-8978-cf83e914e60f","Type":"ContainerStarted","Data":"90302a3691864baea8f2d29a2e3afa1274373391888f5c14c7f591506a9ca44e"} Jun 14 21:38:02.927208 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.927125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" event={"ID":"3fc353a6-ada2-43eb-8978-cf83e914e60f","Type":"ContainerStarted","Data":"d98fcb1a0aaa30b37815a4d31644171b19436a0c4774a0ae1d9bd32e998cfa2a"} Jun 14 21:38:02.927208 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.927155 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" event={"ID":"3fc353a6-ada2-43eb-8978-cf83e914e60f","Type":"ContainerStarted","Data":"e5e47982b22fbb11968147160ca3c45f9a99e74271e8c995d2478111f8c03174"} Jun 14 21:38:02.929066 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.929034 2562 generic.go:356] "Generic (PLEG): container finished" podID="d002fcf6-741f-4f2f-b1e1-94ebd57c2427" containerID="93c5de84299f2055f571602b5ad1a7b787e4ebe8f52ea54e534cfd5a40cb0f75" exitCode=0 Jun 14 21:38:02.929184 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:02.929076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4qxv" event={"ID":"d002fcf6-741f-4f2f-b1e1-94ebd57c2427","Type":"ContainerDied","Data":"93c5de84299f2055f571602b5ad1a7b787e4ebe8f52ea54e534cfd5a40cb0f75"} Jun 14 21:38:03.075384 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.075353 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 21:38:03.081224 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:38:03.081197 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f95ec2_35c1_48d9_8571_aaf574092eaf.slice/crio-723a196ccdb36e6fc0e62e1e2c2b461ee93830c82baeec3df8bd7e21827d5e3e WatchSource:0}: Error finding container 723a196ccdb36e6fc0e62e1e2c2b461ee93830c82baeec3df8bd7e21827d5e3e: Status 404 returned error can't find the container with id 723a196ccdb36e6fc0e62e1e2c2b461ee93830c82baeec3df8bd7e21827d5e3e Jun 14 21:38:03.856024 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.855986 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:03.920935 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.920884 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:03.921121 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.920959 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-76bf566b8b-88hx8"] Jun 14 21:38:03.954881 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.954839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" event={"ID":"3fc353a6-ada2-43eb-8978-cf83e914e60f","Type":"ContainerStarted","Data":"2161f3a74639c85c96b27bf531111e51720b47d1d253c701cfa3613edd09d1ba"} Jun 14 21:38:03.955083 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.954900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerStarted","Data":"723a196ccdb36e6fc0e62e1e2c2b461ee93830c82baeec3df8bd7e21827d5e3e"} Jun 14 21:38:03.955083 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.954951 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76bf566b8b-88hx8"] Jun 14 21:38:03.955083 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.955002 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4qxv" event={"ID":"d002fcf6-741f-4f2f-b1e1-94ebd57c2427","Type":"ContainerStarted","Data":"7dc2dcbdd122acc43323b9d0eea0dc6355375bcb88fd7ae7f862ce28775ad88d"} Jun 14 21:38:03.955083 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.955026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4qxv" event={"ID":"d002fcf6-741f-4f2f-b1e1-94ebd57c2427","Type":"ContainerStarted","Data":"245b3ca4804a57d883968483ed96edc9676d5c0385820f73a5aacfd33c42f208"} Jun 14 21:38:03.955288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.955136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:03.956444 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.956392 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bc44b" podStartSLOduration=2.71251736 podStartE2EDuration="3.956378155s" totalImagesPullingTime="1.243860795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:03.954512459 +0000 UTC m=+272.305132336" watchObservedRunningTime="2026-06-14 21:38:03.956378155 +0000 UTC m=+272.306998026" Jun 14 21:38:03.957943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.957687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 21:38:03.957943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.957737 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 21:38:03.957943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.957784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 21:38:03.957943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.957784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hvswk\"" Jun 14 21:38:03.957943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.957791 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-982elcscea2ck\"" Jun 14 21:38:03.957943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.957799 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 21:38:03.958277 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.958099 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 21:38:03.974210 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:03.974164 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v4qxv" podStartSLOduration=3.012734403 podStartE2EDuration="3.974149849s" totalImagesPullingTime="889.210542ms" totalInitContainerRuntime="72.204904ms" isStatefulPod=true podCreationTimestamp="2026-06-14 21:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:03.9730469 +0000 UTC m=+272.323666795" watchObservedRunningTime="2026-06-14 21:38:03.974149849 +0000 UTC m=+272.324769721" Jun 14 21:38:04.004860 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.004822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-grpc-tls\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.005022 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.004977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-tls\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.005090 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.005017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.005090 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.005043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hzb\" (UniqueName: \"kubernetes.io/projected/ba3de88f-8617-4a2d-84ab-1b374d38584f-kube-api-access-j2hzb\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.005200 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.005105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.005200 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.005141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3de88f-8617-4a2d-84ab-1b374d38584f-metrics-client-ca\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.005334 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.005309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.005455 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.005347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.077877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.077841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:04.106238 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-tls\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.106238 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.106238 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hzb\" (UniqueName: \"kubernetes.io/projected/ba3de88f-8617-4a2d-84ab-1b374d38584f-kube-api-access-j2hzb\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.106425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.106425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3de88f-8617-4a2d-84ab-1b374d38584f-metrics-client-ca\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.106425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.106425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.106425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.106411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-grpc-tls\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.107368 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.107333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3de88f-8617-4a2d-84ab-1b374d38584f-metrics-client-ca\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.109286 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.108965 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.109286 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.109001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.109286 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.109217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.109286 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.109223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.109286 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.109277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-grpc-tls\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.109286 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.109286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba3de88f-8617-4a2d-84ab-1b374d38584f-secret-thanos-querier-tls\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.114389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.114369 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hzb\" (UniqueName: \"kubernetes.io/projected/ba3de88f-8617-4a2d-84ab-1b374d38584f-kube-api-access-j2hzb\") pod \"thanos-querier-76bf566b8b-88hx8\" (UID: \"ba3de88f-8617-4a2d-84ab-1b374d38584f\") " pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.179422 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.179390 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:04.266752 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.266722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:04.405146 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.405070 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76bf566b8b-88hx8"] Jun 14 21:38:04.474949 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:38:04.474909 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3de88f_8617_4a2d_84ab_1b374d38584f.slice/crio-74cef4579cf0bdd7297236e6cdd36fe564fca316c4846eaef78ea91d99595cda WatchSource:0}: Error finding container 74cef4579cf0bdd7297236e6cdd36fe564fca316c4846eaef78ea91d99595cda: Status 404 returned error can't find the container with id 74cef4579cf0bdd7297236e6cdd36fe564fca316c4846eaef78ea91d99595cda Jun 14 21:38:04.946847 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.946817 2562 generic.go:356] "Generic (PLEG): container finished" podID="49f95ec2-35c1-48d9-8571-aaf574092eaf" containerID="021d2c5494c6e7d8269287091c2f2552873fb94cf50f6b0104c3d4d44ba91587" exitCode=0 Jun 14 21:38:04.947343 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.946884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerDied","Data":"021d2c5494c6e7d8269287091c2f2552873fb94cf50f6b0104c3d4d44ba91587"} Jun 14 21:38:04.948222 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:04.948198 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" event={"ID":"ba3de88f-8617-4a2d-84ab-1b374d38584f","Type":"ContainerStarted","Data":"74cef4579cf0bdd7297236e6cdd36fe564fca316c4846eaef78ea91d99595cda"} Jun 14 21:38:05.726218 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:05.726120 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:05.832638 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:05.832600 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:05.921292 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:05.921245 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:06.960984 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:06.960953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerStarted","Data":"53538b01bc70a62c1a6a8c41779d27e0cdfe420c275e0a0bb9838f5ee039b609"} Jun 14 21:38:06.961330 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:06.961053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerStarted","Data":"89ff5c2f1a3d16f3ee55dbb3a2d69583975b931f55b283291562a084e0ee414e"} Jun 14 21:38:06.961330 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:06.961083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerStarted","Data":"eee70ec8de8c3f6584982b75de172592b234cbdc7bbf175bafb48522d8843cb7"} Jun 14 21:38:06.961330 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:06.961110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerStarted","Data":"b99fe44731d7da1621e4b03f5662bcbc42d1fadb712d8a49c6fbfbc1f3d9b114"} Jun 14 21:38:06.963251 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:06.963227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" event={"ID":"ba3de88f-8617-4a2d-84ab-1b374d38584f","Type":"ContainerStarted","Data":"5a161120303c6488fedf9ddbaa7dcf3fe22216be1395ce99524674757147a39e"} Jun 14 21:38:06.963312 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:06.963289 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" event={"ID":"ba3de88f-8617-4a2d-84ab-1b374d38584f","Type":"ContainerStarted","Data":"f055b68c3f9f12054129326e8919077d165abd3085512703359b6cfb15c40f63"} Jun 14 21:38:06.963346 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:06.963322 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" event={"ID":"ba3de88f-8617-4a2d-84ab-1b374d38584f","Type":"ContainerStarted","Data":"9658f551a94ebe925ab944fb1b2241d18726fe2a68b2d4be4d3a03c7d6a98c80"} Jun 14 21:38:07.146107 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.146072 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:07.149970 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.149941 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 21:38:07.153917 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.153898 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.159704 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.159680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 21:38:07.159846 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.159750 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aavhqbc8r6qcc\"" Jun 14 21:38:07.160188 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160169 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 21:38:07.160525 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160320 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 21:38:07.160649 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160586 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 21:38:07.160649 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160619 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 21:38:07.160807 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160778 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 21:38:07.160868 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 21:38:07.160868 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160833 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 21:38:07.160964 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160880 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 21:38:07.160964 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 21:38:07.160964 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.160883 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 21:38:07.161175 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.161153 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gst9s\"" Jun 14 21:38:07.161364 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.161350 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 21:38:07.161530 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.161515 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 21:38:07.161759 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.161743 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 21:38:07.165587 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.165554 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 21:38:07.173042 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.172973 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 21:38:07.238016 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.237977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238223 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238223 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhkzx\" (UniqueName: \"kubernetes.io/projected/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-kube-api-access-fhkzx\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238223 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238223 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238443 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238443 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238443 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238443 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238443 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238443 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-config\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.238756 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.238719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.339793 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.339757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.339793 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.339801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340050 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.339821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhkzx\" (UniqueName: \"kubernetes.io/projected/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-kube-api-access-fhkzx\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340225 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340359 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340359 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340359 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340525 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340525 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340525 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340525 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-config\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340525 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.340812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.340761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.341198 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.341009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.341198 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.341114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.342152 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.342126 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.342726 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.342700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.342864 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.342844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.343179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.342960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.343179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.343128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.343721 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.343369 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.343865 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.343837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.344729 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.344704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.345205 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.345178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.345904 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.345741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.346203 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.346174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.346490 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.346376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.347174 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.347133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-config\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.347308 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.347287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.347632 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.347613 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.347912 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.347890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.348616 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.348598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.351471 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.351443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhkzx\" (UniqueName: \"kubernetes.io/projected/0a03118a-c26d-4f02-ab2c-7a1b20fd481f-kube-api-access-fhkzx\") pod \"prometheus-k8s-0\" (UID: \"0a03118a-c26d-4f02-ab2c-7a1b20fd481f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.463709 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.463588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:07.663954 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.663917 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 21:38:07.666826 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:38:07.666791 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a03118a_c26d_4f02_ab2c_7a1b20fd481f.slice/crio-fc5a22efb0e268aa83a5db5a18e33dbe86a80ac5074f3870b8be6e34a1baf999 WatchSource:0}: Error finding container fc5a22efb0e268aa83a5db5a18e33dbe86a80ac5074f3870b8be6e34a1baf999: Status 404 returned error can't find the container with id fc5a22efb0e268aa83a5db5a18e33dbe86a80ac5074f3870b8be6e34a1baf999 Jun 14 21:38:07.970497 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.970449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" event={"ID":"ba3de88f-8617-4a2d-84ab-1b374d38584f","Type":"ContainerStarted","Data":"71a40985a993f60d191672735a172c5a20f29247bae79953100f5744ba1b8dfe"} Jun 14 21:38:07.970996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.970557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" event={"ID":"ba3de88f-8617-4a2d-84ab-1b374d38584f","Type":"ContainerStarted","Data":"e5f9ae5dafd8fff3633bce53bd6ec53c1021bfc00227e05e459179e2f121c239"} Jun 14 21:38:07.970996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.970640 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:07.970996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.970684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" event={"ID":"ba3de88f-8617-4a2d-84ab-1b374d38584f","Type":"ContainerStarted","Data":"40095e213be7acdac2bb3cf8b2526a23c31c4c7b4f1091c628f3e44872c9e09c"} Jun 14 21:38:07.973755 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.973728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerStarted","Data":"4ae4274d61f4da3f385999f3e03fedf1132ae7600c8a20de844384f455968e3c"} Jun 14 21:38:07.973891 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.973787 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49f95ec2-35c1-48d9-8571-aaf574092eaf","Type":"ContainerStarted","Data":"3d4ba67b2007099b7b2bc2546117cef72f1a11f0c5a0a38692f4df8c736246cf"} Jun 14 21:38:07.975240 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.975217 2562 generic.go:356] "Generic (PLEG): container finished" podID="0a03118a-c26d-4f02-ab2c-7a1b20fd481f" containerID="f54fcb7d9cdf5f2ebff211ebf3b23c12acae1542df7f7d06ffb98ca15c010c47" exitCode=0 Jun 14 21:38:07.975409 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.975295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerDied","Data":"f54fcb7d9cdf5f2ebff211ebf3b23c12acae1542df7f7d06ffb98ca15c010c47"} Jun 14 21:38:07.975409 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.975362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerStarted","Data":"fc5a22efb0e268aa83a5db5a18e33dbe86a80ac5074f3870b8be6e34a1baf999"} Jun 14 21:38:07.990852 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:07.990760 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" podStartSLOduration=2.10003829 podStartE2EDuration="4.990745288s" totalImagesPullingTime="2.890706998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:38:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:07.988991681 +0000 UTC m=+276.339611552" watchObservedRunningTime="2026-06-14 21:38:07.990745288 +0000 UTC m=+276.341365159" Jun 14 21:38:08.012860 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:08.012806 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.270239802 podStartE2EDuration="7.012788499s" totalImagesPullingTime="3.72769327s" totalInitContainerRuntime="14.855427ms" isStatefulPod=false podCreationTimestamp="2026-06-14 21:38:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:08.01115122 +0000 UTC m=+276.361771092" watchObservedRunningTime="2026-06-14 21:38:08.012788499 +0000 UTC m=+276.363408370" Jun 14 21:38:08.325749 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:08.325710 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:10.133588 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:10.133529 2562 patch_prober.go:28] interesting pod/console-5bb7f7cff-jt2pm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 14 21:38:10.134072 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:10.133621 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bb7f7cff-jt2pm" podUID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 14 21:38:10.991530 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:10.991454 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerStarted","Data":"4d86ea6dcab6101a83d35ce2a89ae44b7e600dcfd2a71d6f9c33b977ac5cedf9"} Jun 14 21:38:10.991684 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:10.991550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerStarted","Data":"0a9ab343db0b7cad975b95e1b7b74c2ae2bf0754d2380dc09ccdde0df52a4a72"} Jun 14 21:38:10.991684 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:10.991607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerStarted","Data":"d956af03b9b000639bf7b5de953acc506dd2b8bc66d07e013b34eb8fbbe1f507"} Jun 14 21:38:11.998334 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:11.998302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerStarted","Data":"367818c74fa0a5c1bc21ef4f8cd1503eee145ae347f99282f15b12ab37604483"} Jun 14 21:38:11.998695 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:11.998364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerStarted","Data":"6488680901c09f5b1c437e199bc333704e4e083e7b31082c218a4d30d2281fb5"} Jun 14 21:38:11.998695 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:11.998389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0a03118a-c26d-4f02-ab2c-7a1b20fd481f","Type":"ContainerStarted","Data":"8dfdf672f4e57c1a079db3841f0a3070b6b872140b444b12749474ea00b4d300"} Jun 14 21:38:12.025151 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:12.025104 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.24042543 podStartE2EDuration="5.025089768s" totalImagesPullingTime="2.75941302s" totalInitContainerRuntime="25.251318ms" isStatefulPod=false podCreationTimestamp="2026-06-14 21:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:12.024267816 +0000 UTC m=+280.374887698" watchObservedRunningTime="2026-06-14 21:38:12.025089768 +0000 UTC m=+280.375709639" Jun 14 21:38:12.464052 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:12.464019 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:38:12.556475 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:12.556440 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fnc7x" podUID="598ed8ce-96cb-40c9-ad90-a0293cc67363" Jun 14 21:38:13.002428 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:13.002398 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fnc7x" Jun 14 21:38:13.987399 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:13.987361 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-76bf566b8b-88hx8" Jun 14 21:38:15.765249 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:15.765215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:15.818116 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:15.818074 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:15.924046 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:15.924013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:38:15.926420 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:15.926389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/598ed8ce-96cb-40c9-ad90-a0293cc67363-metrics-tls\") pod \"dns-default-fnc7x\" (UID: \"598ed8ce-96cb-40c9-ad90-a0293cc67363\") " pod="openshift-dns/dns-default-fnc7x" Jun 14 21:38:16.005623 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:16.005563 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dh44t\"" Jun 14 21:38:16.013803 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:16.013775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fnc7x" Jun 14 21:38:16.162657 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:16.162627 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fnc7x"] Jun 14 21:38:16.166159 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:38:16.166134 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598ed8ce_96cb_40c9_ad90_a0293cc67363.slice/crio-916e4b8ee74fedc891a4c8069c5597f2a069deb4f6dcea44579a342124141753 WatchSource:0}: Error finding container 916e4b8ee74fedc891a4c8069c5597f2a069deb4f6dcea44579a342124141753: Status 404 returned error can't find the container with id 916e4b8ee74fedc891a4c8069c5597f2a069deb4f6dcea44579a342124141753 Jun 14 21:38:17.019939 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:17.019903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fnc7x" event={"ID":"598ed8ce-96cb-40c9-ad90-a0293cc67363","Type":"ContainerStarted","Data":"916e4b8ee74fedc891a4c8069c5597f2a069deb4f6dcea44579a342124141753"} Jun 14 21:38:17.921598 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:17.921489 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:18.025935 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:18.025906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fnc7x" event={"ID":"598ed8ce-96cb-40c9-ad90-a0293cc67363","Type":"ContainerStarted","Data":"d304b7f08303c23c5579c004be30aadbccc1c2a3df5ca46cb356768574f6cdf9"} Jun 14 21:38:18.026345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:18.025956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fnc7x" event={"ID":"598ed8ce-96cb-40c9-ad90-a0293cc67363","Type":"ContainerStarted","Data":"50f7522db156d4eb6184df75f677217ecfcbd715103ddb02ee9eedd668808b7f"} Jun 14 21:38:18.026345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:18.026012 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fnc7x" Jun 14 21:38:18.040858 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:18.040812 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fnc7x" podStartSLOduration=251.51369572 podStartE2EDuration="4m13.040797992s" totalImagesPullingTime="1.527102272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:18.039875095 +0000 UTC m=+286.390494989" watchObservedRunningTime="2026-06-14 21:38:18.040797992 +0000 UTC m=+286.391417862" Jun 14 21:38:19.425786 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:19.425749 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/init-config-reloader/0.log" Jun 14 21:38:19.624837 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:19.624797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/alertmanager/0.log" Jun 14 21:38:19.824949 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:19.824918 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/config-reloader/0.log" Jun 14 21:38:20.024910 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.024885 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/kube-rbac-proxy-web/0.log" Jun 14 21:38:20.137913 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.137836 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:38:20.141675 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.141650 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:38:20.225069 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.225042 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/kube-rbac-proxy/0.log" Jun 14 21:38:20.269862 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.269827 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:20.424870 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.424797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/kube-rbac-proxy-metric/0.log" Jun 14 21:38:20.625089 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.625064 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/prom-label-proxy/0.log" Jun 14 21:38:20.826939 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:20.826912 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-n5tm8_5419fc9c-4dab-4b61-895d-4b402a659438/cluster-monitoring-operator/0.log" Jun 14 21:38:21.422235 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:21.422202 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:22.624184 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:22.624157 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4qxv_d002fcf6-741f-4f2f-b1e1-94ebd57c2427/init-textfile/0.log" Jun 14 21:38:22.826684 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:22.826657 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4qxv_d002fcf6-741f-4f2f-b1e1-94ebd57c2427/node-exporter/0.log" Jun 14 21:38:23.025320 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:23.025293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4qxv_d002fcf6-741f-4f2f-b1e1-94ebd57c2427/kube-rbac-proxy/0.log" Jun 14 21:38:23.819340 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:23.819299 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:23.824630 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:23.824602 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bc44b_3fc353a6-ada2-43eb-8978-cf83e914e60f/kube-rbac-proxy-main/0.log" Jun 14 21:38:23.920717 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:23.920684 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:24.024810 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:24.024770 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bc44b_3fc353a6-ada2-43eb-8978-cf83e914e60f/kube-rbac-proxy-self/0.log" Jun 14 21:38:24.224528 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:24.224456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bc44b_3fc353a6-ada2-43eb-8978-cf83e914e60f/openshift-state-metrics/0.log" Jun 14 21:38:24.424555 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:24.424528 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/init-config-reloader/0.log" Jun 14 21:38:24.626317 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:24.626284 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/prometheus/0.log" Jun 14 21:38:24.743383 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:24.743349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:24.794381 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:24.794349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:24.825603 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:24.825560 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/config-reloader/0.log" Jun 14 21:38:25.024775 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:25.024750 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/thanos-sidecar/0.log" Jun 14 21:38:25.224714 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:25.224681 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/kube-rbac-proxy-web/0.log" Jun 14 21:38:25.425003 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:25.424929 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/kube-rbac-proxy/0.log" Jun 14 21:38:25.625740 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:25.625707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/kube-rbac-proxy-thanos/0.log" Jun 14 21:38:26.173965 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:26.173935 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb7f7cff-jt2pm"] Jun 14 21:38:26.275396 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:26.275360 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:26.376270 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:26.376232 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:26.424452 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:26.424369 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/thanos-query/0.log" Jun 14 21:38:26.435151 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:26.435117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:26.624511 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:26.624485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy-web/0.log" Jun 14 21:38:26.825004 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:26.824975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy/0.log" Jun 14 21:38:27.024407 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:27.024378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/prom-label-proxy/0.log" Jun 14 21:38:27.224000 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:27.223892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy-rules/0.log" Jun 14 21:38:27.425467 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:27.425423 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy-metrics/0.log" Jun 14 21:38:27.624341 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:27.624311 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-zhwlj_95afa596-dedc-439e-9805-2dc4fae1bfed/networking-console-plugin/0.log" Jun 14 21:38:28.015380 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:28.015330 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:28.031550 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:28.031527 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fnc7x" Jun 14 21:38:28.115263 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:28.115226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:28.169889 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:28.169857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:28.425892 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:28.425820 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bb7f7cff-jt2pm_f90604c2-d283-4d1b-a8c2-dd6cb7d51739/console/0.log" Jun 14 21:38:29.424861 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:29.424835 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fnc7x_598ed8ce-96cb-40c9-ad90-a0293cc67363/dns/0.log" Jun 14 21:38:29.624632 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:29.624592 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fnc7x_598ed8ce-96cb-40c9-ad90-a0293cc67363/kube-rbac-proxy/0.log" Jun 14 21:38:30.223968 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:30.223941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8zpj_996f5f9e-8ec3-4f0f-95a5-84b68d052d83/dns-node-resolver/0.log" Jun 14 21:38:30.758459 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:30.758409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:30.806622 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:30.806582 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:31.225242 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:31.225217 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d5z8n_2b3d6888-b153-4809-b707-ec7b852a8341/node-ca/0.log" Jun 14 21:38:31.825434 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:31.825400 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86b4776d-qj94x_c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7/router/0.log" Jun 14 21:38:32.041986 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:32.041962 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:38:32.042127 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:32.042095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:38:32.047130 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:32.047115 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 21:38:32.229324 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:32.229127 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-prbbn_3248c498-13d0-4d68-b422-7d189af93401/serve-healthcheck-canary/0.log" Jun 14 21:38:33.494944 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:33.494906 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:33.595202 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:33.595168 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:33.696704 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:33.696668 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:35.106241 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:35.106211 2562 generic.go:356] "Generic (PLEG): container finished" podID="d7fecedc-aee2-425e-b06e-0c4aa490e673" containerID="83949dc5ee22be63f1dc25745fa457c1596cdced5272e8449d79257f223e1b9c" exitCode=0 Jun 14 21:38:35.106647 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:35.106270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" event={"ID":"d7fecedc-aee2-425e-b06e-0c4aa490e673","Type":"ContainerDied","Data":"83949dc5ee22be63f1dc25745fa457c1596cdced5272e8449d79257f223e1b9c"} Jun 14 21:38:35.106647 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:35.106601 2562 scope.go:117] "RemoveContainer" containerID="83949dc5ee22be63f1dc25745fa457c1596cdced5272e8449d79257f223e1b9c" Jun 14 21:38:36.113300 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:36.113263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7bkfv" event={"ID":"d7fecedc-aee2-425e-b06e-0c4aa490e673","Type":"ContainerStarted","Data":"d2bb56d8c5d398497e49e05e34a8fee72dc8aaef603d1ec1f6abc58e45c9b848"} Jun 14 21:38:37.092487 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:37.092451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:37.193480 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:37.193439 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:39.186965 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:39.186930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:39.238679 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:39.238635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:42.756566 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:42.756530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:42.805807 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:42.805773 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:45.764021 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:45.763982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:45.820828 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:45.820788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:38:51.202843 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.202804 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bb7f7cff-jt2pm" podUID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" containerName="console" containerID="cri-o://fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63" gracePeriod=15 Jun 14 21:38:51.447778 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.447755 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:38:51.557815 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.557779 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-oauth-config\") pod \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " Jun 14 21:38:51.558014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.557826 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-trusted-ca-bundle\") pod \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " Jun 14 21:38:51.558014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.557850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-oauth-serving-cert\") pod \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " Jun 14 21:38:51.558014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.557884 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-serving-cert\") pod \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " Jun 14 21:38:51.558014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.557916 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6nw9\" (UniqueName: \"kubernetes.io/projected/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-kube-api-access-p6nw9\") pod \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " Jun 14 21:38:51.558229 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.558097 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-config\") pod \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " Jun 14 21:38:51.558229 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.558157 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-service-ca\") pod \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\" (UID: \"f90604c2-d283-4d1b-a8c2-dd6cb7d51739\") " Jun 14 21:38:51.558326 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.558222 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f90604c2-d283-4d1b-a8c2-dd6cb7d51739" (UID: "f90604c2-d283-4d1b-a8c2-dd6cb7d51739"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 21:38:51.558433 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.558393 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f90604c2-d283-4d1b-a8c2-dd6cb7d51739" (UID: "f90604c2-d283-4d1b-a8c2-dd6cb7d51739"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 21:38:51.558509 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.558474 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-oauth-serving-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:38:51.558566 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.558503 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-config" (OuterVolumeSpecName: "console-config") pod "f90604c2-d283-4d1b-a8c2-dd6cb7d51739" (UID: "f90604c2-d283-4d1b-a8c2-dd6cb7d51739"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 21:38:51.558692 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.558666 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-service-ca" (OuterVolumeSpecName: "service-ca") pod "f90604c2-d283-4d1b-a8c2-dd6cb7d51739" (UID: "f90604c2-d283-4d1b-a8c2-dd6cb7d51739"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 21:38:51.560302 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.560281 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f90604c2-d283-4d1b-a8c2-dd6cb7d51739" (UID: "f90604c2-d283-4d1b-a8c2-dd6cb7d51739"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 21:38:51.560545 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.560523 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f90604c2-d283-4d1b-a8c2-dd6cb7d51739" (UID: "f90604c2-d283-4d1b-a8c2-dd6cb7d51739"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 21:38:51.560641 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.560620 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-kube-api-access-p6nw9" (OuterVolumeSpecName: "kube-api-access-p6nw9") pod "f90604c2-d283-4d1b-a8c2-dd6cb7d51739" (UID: "f90604c2-d283-4d1b-a8c2-dd6cb7d51739"). InnerVolumeSpecName "kube-api-access-p6nw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:38:51.659156 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.659116 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-config\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:38:51.659156 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.659152 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-service-ca\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:38:51.659156 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.659161 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-oauth-config\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:38:51.659389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.659173 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-trusted-ca-bundle\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:38:51.659389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.659182 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-console-serving-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:38:51.659389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:51.659190 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6nw9\" (UniqueName: \"kubernetes.io/projected/f90604c2-d283-4d1b-a8c2-dd6cb7d51739-kube-api-access-p6nw9\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:38:52.182411 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.182374 2562 generic.go:356] "Generic (PLEG): container finished" podID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" containerID="fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63" exitCode=0 Jun 14 21:38:52.182621 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.182426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb7f7cff-jt2pm" event={"ID":"f90604c2-d283-4d1b-a8c2-dd6cb7d51739","Type":"ContainerDied","Data":"fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63"} Jun 14 21:38:52.182621 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.182444 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bb7f7cff-jt2pm" Jun 14 21:38:52.182621 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.182499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bb7f7cff-jt2pm" event={"ID":"f90604c2-d283-4d1b-a8c2-dd6cb7d51739","Type":"ContainerDied","Data":"377fddfc9b1f6b7d708377baeb9fccc72292f7a8a6f262c9ad886c326a5bad9b"} Jun 14 21:38:52.182621 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.182520 2562 scope.go:117] "RemoveContainer" containerID="fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63" Jun 14 21:38:52.191269 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.191248 2562 scope.go:117] "RemoveContainer" containerID="fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63" Jun 14 21:38:52.191516 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:38:52.191498 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63\": container with ID starting with fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63 not found: ID does not exist" containerID="fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63" Jun 14 21:38:52.191580 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.191523 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63"} err="failed to get container status \"fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63\": rpc error: code = NotFound desc = could not find container \"fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63\": container with ID starting with fe870374b26bc6c00e16580a1b363e1ac9ac8e1f2371632adc4c1a74592e9a63 not found: ID does not exist" Jun 14 21:38:52.198405 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.198376 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bb7f7cff-jt2pm"] Jun 14 21:38:52.202151 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:52.202131 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bb7f7cff-jt2pm"] Jun 14 21:38:54.080063 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:38:54.080033 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" path="/var/lib/kubelet/pods/f90604c2-d283-4d1b-a8c2-dd6cb7d51739/volumes" Jun 14 21:39:00.249267 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:00.249236 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:00.302324 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:00.302281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:00.760494 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:00.760461 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:00.815475 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:00.815422 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:01.903814 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:01.903776 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:02.004771 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:02.004736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:02.061169 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:02.061134 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:06.480447 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:06.480385 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:07.464662 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:07.464607 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:39:07.480698 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:07.480673 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:39:08.266511 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:08.266487 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 21:39:15.768495 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:15.768409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:15.829127 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:15.829096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:20.122729 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:20.122693 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:20.859877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:20.859846 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:29.697615 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:29.697558 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:29.783551 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:29.783514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:29.845171 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:29.845141 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:29.896801 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:29.896767 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:30.657876 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:30.657840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:30.707543 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:30.707506 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:35.342934 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:35.342897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:35.417810 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:35.417781 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:35.550045 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:35.550009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:35.608417 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:35.608314 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:36.128891 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:36.128836 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:46.186360 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:46.186321 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:46.236073 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:46.236037 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:46.288397 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:46.288348 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:47.234797 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:47.234756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:47.335239 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:47.335203 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:47.571158 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:47.571129 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:39:47.621952 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:39:47.621924 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:00.775190 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:00.775155 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:00.875781 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:00.875742 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:19.672026 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:19.671980 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:19.777893 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:19.777857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:27.499945 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:27.499904 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:27.583628 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:27.583589 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:41.036969 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:41.036935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:42.421282 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:42.421234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:44.622368 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:44.622326 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:44.721697 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:44.721660 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:45.663831 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:45.663755 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:45.762231 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:45.762201 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:49.111419 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:49.111372 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:49.505301 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:49.505225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:51.613367 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:51.613335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:51.715049 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:51.715017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:54.311482 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:54.311450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:54.411392 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:54.411355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:40:56.715243 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:40:56.715192 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:02.039880 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:02.039842 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:02.129372 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:02.129337 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:08.148998 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:08.148967 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:08.250536 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:08.250504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:10.457681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:10.457637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:22.482863 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:22.482826 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:22.576598 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:22.576552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.054474 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.054437 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.314947 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.314850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.422500 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.422468 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.499674 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.499639 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4"] Jun 14 21:41:23.500050 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.499969 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" containerName="console" Jun 14 21:41:23.500050 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.499980 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" containerName="console" Jun 14 21:41:23.500050 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.500042 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90604c2-d283-4d1b-a8c2-dd6cb7d51739" containerName="console" Jun 14 21:41:23.503078 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.503057 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.505601 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.505580 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 21:41:23.506157 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.506137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2s2vx\"" Jun 14 21:41:23.506257 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.506238 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 21:41:23.506304 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.506269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 21:41:23.506396 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.506381 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 21:41:23.528788 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.528762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4"] Jun 14 21:41:23.602681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.602559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06d30a58-2d90-4316-98ed-8248ca987b1c-manifests\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.602681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.602638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06d30a58-2d90-4316-98ed-8248ca987b1c-tmp\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.602681 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.602672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbgdc\" (UniqueName: \"kubernetes.io/projected/06d30a58-2d90-4316-98ed-8248ca987b1c-kube-api-access-jbgdc\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.602906 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.602697 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06d30a58-2d90-4316-98ed-8248ca987b1c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.602906 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.602748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06d30a58-2d90-4316-98ed-8248ca987b1c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.635449 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.635418 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.703729 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.703690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06d30a58-2d90-4316-98ed-8248ca987b1c-tmp\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.703897 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.703757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbgdc\" (UniqueName: \"kubernetes.io/projected/06d30a58-2d90-4316-98ed-8248ca987b1c-kube-api-access-jbgdc\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.703897 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.703794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06d30a58-2d90-4316-98ed-8248ca987b1c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.703897 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.703829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06d30a58-2d90-4316-98ed-8248ca987b1c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.704053 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.703901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06d30a58-2d90-4316-98ed-8248ca987b1c-manifests\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.704279 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.704256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06d30a58-2d90-4316-98ed-8248ca987b1c-manifests\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.706097 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.706078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06d30a58-2d90-4316-98ed-8248ca987b1c-tmp\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.706345 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.706326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06d30a58-2d90-4316-98ed-8248ca987b1c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.706409 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.706358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06d30a58-2d90-4316-98ed-8248ca987b1c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.711427 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.711401 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbgdc\" (UniqueName: \"kubernetes.io/projected/06d30a58-2d90-4316-98ed-8248ca987b1c-kube-api-access-jbgdc\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-xqnw4\" (UID: \"06d30a58-2d90-4316-98ed-8248ca987b1c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.727830 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.727802 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.813388 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.813347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:23.827792 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.827751 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.940436 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.940405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:23.969514 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.969489 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4"] Jun 14 21:41:23.972724 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:41:23.972693 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d30a58_2d90_4316_98ed_8248ca987b1c.slice/crio-70562f2aaf50fc8d14ffb46686f3044bc3e9c2dc3c98463b4dfd0a87e19c4e0c WatchSource:0}: Error finding container 70562f2aaf50fc8d14ffb46686f3044bc3e9c2dc3c98463b4dfd0a87e19c4e0c: Status 404 returned error can't find the container with id 70562f2aaf50fc8d14ffb46686f3044bc3e9c2dc3c98463b4dfd0a87e19c4e0c Jun 14 21:41:23.974597 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:23.974558 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 21:41:24.062059 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:24.062028 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:24.161119 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:24.161013 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:24.263314 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:24.263283 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:24.801630 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:24.801535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" event={"ID":"06d30a58-2d90-4316-98ed-8248ca987b1c","Type":"ContainerStarted","Data":"70562f2aaf50fc8d14ffb46686f3044bc3e9c2dc3c98463b4dfd0a87e19c4e0c"} Jun 14 21:41:27.816841 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:27.816811 2562 generic.go:356] "Generic (PLEG): container finished" podID="06d30a58-2d90-4316-98ed-8248ca987b1c" containerID="1047d3d8b2f3b8681a3860feb28b6c797a9d9f2ccf2998aeaf905f1271ffbbbe" exitCode=0 Jun 14 21:41:27.817188 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:27.816900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" event={"ID":"06d30a58-2d90-4316-98ed-8248ca987b1c","Type":"ContainerDied","Data":"1047d3d8b2f3b8681a3860feb28b6c797a9d9f2ccf2998aeaf905f1271ffbbbe"} Jun 14 21:41:28.822563 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:28.822526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" event={"ID":"06d30a58-2d90-4316-98ed-8248ca987b1c","Type":"ContainerStarted","Data":"e2e81714d65c816f0b7c45d069648f135c7957412231ba2e1b3eb5f3c88502fe"} Jun 14 21:41:28.823050 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:28.822621 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:28.846980 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:28.846925 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" podStartSLOduration=1.819611898 podStartE2EDuration="5.846905809s" totalImagesPullingTime="3.087017508s" totalInitContainerRuntime="940.276403ms" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:28.84481621 +0000 UTC m=+477.195436081" watchObservedRunningTime="2026-06-14 21:41:28.846905809 +0000 UTC m=+477.197525679" Jun 14 21:41:33.548750 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:33.548713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:33.643828 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:33.643789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:33.964111 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:33.964035 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:34.063943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:34.063901 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:34.719947 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:34.719911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:34.859452 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:34.859420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:39.829857 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:39.829829 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-xqnw4" Jun 14 21:41:40.076477 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:40.076442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:42.721362 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:42.721322 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:42.859674 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:42.859628 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:43.299693 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.299654 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp"] Jun 14 21:41:43.309963 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.309938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.313392 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.313369 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 21:41:43.313789 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.313773 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 21:41:43.314136 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.314113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 21:41:43.314237 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.314113 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 21:41:43.314237 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.314122 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-srx95\"" Jun 14 21:41:43.314237 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.314177 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 21:41:43.319918 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.319813 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp"] Jun 14 21:41:43.369889 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.369860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b079ed4-c2b9-4395-94c2-06e434dabfb4-cert\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.370038 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.369897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b079ed4-c2b9-4395-94c2-06e434dabfb4-metrics-cert\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.370038 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.369930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5n7\" (UniqueName: \"kubernetes.io/projected/4b079ed4-c2b9-4395-94c2-06e434dabfb4-kube-api-access-xv5n7\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.370038 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.370025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b079ed4-c2b9-4395-94c2-06e434dabfb4-manager-config\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.470811 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.470770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b079ed4-c2b9-4395-94c2-06e434dabfb4-cert\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.470989 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.470827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b079ed4-c2b9-4395-94c2-06e434dabfb4-metrics-cert\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.470989 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.470883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5n7\" (UniqueName: \"kubernetes.io/projected/4b079ed4-c2b9-4395-94c2-06e434dabfb4-kube-api-access-xv5n7\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.470989 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.470956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b079ed4-c2b9-4395-94c2-06e434dabfb4-manager-config\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.471743 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.471711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b079ed4-c2b9-4395-94c2-06e434dabfb4-manager-config\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.473399 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.473361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b079ed4-c2b9-4395-94c2-06e434dabfb4-cert\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.473399 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.473376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b079ed4-c2b9-4395-94c2-06e434dabfb4-metrics-cert\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.477416 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.477384 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:43.496425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.496389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5n7\" (UniqueName: \"kubernetes.io/projected/4b079ed4-c2b9-4395-94c2-06e434dabfb4-kube-api-access-xv5n7\") pod \"lws-controller-manager-dc5b57b86-g57xp\" (UID: \"4b079ed4-c2b9-4395-94c2-06e434dabfb4\") " pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.627625 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.627518 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:43.627922 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.627886 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:43.747282 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.747245 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:43.797977 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.797945 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp"] Jun 14 21:41:43.801595 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:41:43.801551 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b079ed4_c2b9_4395_94c2_06e434dabfb4.slice/crio-ecf2802ed132d595c6cf6647d3f281af3f5e10a99d10027fc8bb532c5a719c0e WatchSource:0}: Error finding container ecf2802ed132d595c6cf6647d3f281af3f5e10a99d10027fc8bb532c5a719c0e: Status 404 returned error can't find the container with id ecf2802ed132d595c6cf6647d3f281af3f5e10a99d10027fc8bb532c5a719c0e Jun 14 21:41:43.888430 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.888341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" event={"ID":"4b079ed4-c2b9-4395-94c2-06e434dabfb4","Type":"ContainerStarted","Data":"ecf2802ed132d595c6cf6647d3f281af3f5e10a99d10027fc8bb532c5a719c0e"} Jun 14 21:41:43.941555 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:43.941510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:44.477824 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:44.477705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:44.728171 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:44.728056 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:46.905447 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:46.905407 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" event={"ID":"4b079ed4-c2b9-4395-94c2-06e434dabfb4","Type":"ContainerStarted","Data":"d0dce58e30ac9d59a14c68b3e1aff7eeb826e1254f837e3b214131f779a55883"} Jun 14 21:41:46.905882 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:46.905551 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:46.926361 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:46.926310 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" podStartSLOduration=1.797711626 podStartE2EDuration="3.926294017s" totalImagesPullingTime="2.128582391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:46.923905709 +0000 UTC m=+495.274525579" watchObservedRunningTime="2026-06-14 21:41:46.926294017 +0000 UTC m=+495.276913888" Jun 14 21:41:48.700128 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.700092 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:48.794957 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.794924 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:48.842381 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.842345 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq"] Jun 14 21:41:48.845594 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.845551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:48.848699 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.848680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 21:41:48.849433 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.849415 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mh4fq\"" Jun 14 21:41:48.849543 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.849500 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 21:41:48.861438 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.861414 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq"] Jun 14 21:41:48.916679 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.916646 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:48.921455 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.921432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bgcb\" (UniqueName: \"kubernetes.io/projected/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-kube-api-access-7bgcb\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:48.921636 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.921477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-tls-certs\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:48.921636 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:48.921562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-tmp\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.022634 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.022601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bgcb\" (UniqueName: \"kubernetes.io/projected/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-kube-api-access-7bgcb\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.022822 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.022649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-tls-certs\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.022822 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.022689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-tmp\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.025062 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.025035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-tmp\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.025182 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.025111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-tls-certs\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.031120 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.031093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bgcb\" (UniqueName: \"kubernetes.io/projected/ec8ed7f9-a227-44ed-ac29-ede07d3e910e-kube-api-access-7bgcb\") pod \"kube-auth-proxy-ddf4d968b-nq8zq\" (UID: \"ec8ed7f9-a227-44ed-ac29-ede07d3e910e\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.156145 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.156112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" Jun 14 21:41:49.308112 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.308042 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq"] Jun 14 21:41:49.311143 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:41:49.311118 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8ed7f9_a227_44ed_ac29_ede07d3e910e.slice/crio-5380b0e935f9af556fff4ba6adc32ca96af2d75aa0569d8e90293373a2007a72 WatchSource:0}: Error finding container 5380b0e935f9af556fff4ba6adc32ca96af2d75aa0569d8e90293373a2007a72: Status 404 returned error can't find the container with id 5380b0e935f9af556fff4ba6adc32ca96af2d75aa0569d8e90293373a2007a72 Jun 14 21:41:49.921551 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:49.921507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" event={"ID":"ec8ed7f9-a227-44ed-ac29-ede07d3e910e","Type":"ContainerStarted","Data":"5380b0e935f9af556fff4ba6adc32ca96af2d75aa0569d8e90293373a2007a72"} Jun 14 21:41:51.932196 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:51.932164 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" event={"ID":"ec8ed7f9-a227-44ed-ac29-ede07d3e910e","Type":"ContainerStarted","Data":"0214dda7c106658e18c0a1c9140c8ecd2dd6ad2c4ba5d8daa3caa1c572037047"} Jun 14 21:41:54.138837 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:54.138809 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:54.292367 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:54.292335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:54.417709 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:54.417619 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:54.699637 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:54.699513 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:55.469230 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:55.469187 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:55.568998 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:55.568965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:55.630864 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:55.630810 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:57.088720 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:57.088662 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:57.259408 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:57.259369 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:57.913242 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:57.913207 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dc5b57b86-g57xp" Jun 14 21:41:57.953729 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:57.953678 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-nq8zq" podStartSLOduration=7.485027968 podStartE2EDuration="9.953659524s" totalImagesPullingTime="2.468631556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:51.973901815 +0000 UTC m=+500.324521698" watchObservedRunningTime="2026-06-14 21:41:57.953659524 +0000 UTC m=+506.304279396" Jun 14 21:41:58.746801 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:58.746766 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:58.884158 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:58.884119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:59.006385 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:59.006292 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:59.563702 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:59.563666 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:41:59.707615 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:41:59.707581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:04.421309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:04.421281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:10.027491 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:10.027450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:10.128301 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:10.128252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:25.368011 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:25.367979 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:25.424475 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:25.424430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:25.878376 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:25.878323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:26.490161 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:26.490126 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:30.350626 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:30.350592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:30.451136 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:30.451095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:30.652294 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:30.652204 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:30.861517 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:30.861481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:30.963340 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:30.963247 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:33.996827 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:33.996780 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:44.176782 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:44.176750 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:44.274527 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:44.274495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:44.369891 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:44.369860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:49.481410 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:49.481377 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:42:49.534806 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:42:49.534779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:16.308529 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:16.308482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:24.239533 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:24.239496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:27.323891 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:27.323856 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:28.164624 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:28.164565 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:29.199444 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.199412 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f"] Jun 14 21:43:29.202738 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.202721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.204871 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.204846 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 14 21:43:29.205036 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.204892 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6cqvg\"" Jun 14 21:43:29.205725 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.205709 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 14 21:43:29.205827 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.205708 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 21:43:29.205827 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.205743 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 21:43:29.212548 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.212528 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f"] Jun 14 21:43:29.217301 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.217272 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:29.321683 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.321650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wst5\" (UniqueName: \"kubernetes.io/projected/866d14fb-3176-40e7-96c3-a2b86118e929-kube-api-access-4wst5\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.321838 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.321713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/866d14fb-3176-40e7-96c3-a2b86118e929-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.321838 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.321794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866d14fb-3176-40e7-96c3-a2b86118e929-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.427354 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.427314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/866d14fb-3176-40e7-96c3-a2b86118e929-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.427753 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:43:29.427714 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 14 21:43:29.427878 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.427755 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866d14fb-3176-40e7-96c3-a2b86118e929-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.428148 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:43:29.428132 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866d14fb-3176-40e7-96c3-a2b86118e929-plugin-serving-cert podName:866d14fb-3176-40e7-96c3-a2b86118e929 nodeName:}" failed. No retries permitted until 2026-06-14 21:43:29.928107619 +0000 UTC m=+598.278727480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/866d14fb-3176-40e7-96c3-a2b86118e929-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6fm7f" (UID: "866d14fb-3176-40e7-96c3-a2b86118e929") : secret "plugin-serving-cert" not found Jun 14 21:43:29.428209 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.428185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wst5\" (UniqueName: \"kubernetes.io/projected/866d14fb-3176-40e7-96c3-a2b86118e929-kube-api-access-4wst5\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.428830 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.428792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866d14fb-3176-40e7-96c3-a2b86118e929-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.441869 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.441844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wst5\" (UniqueName: \"kubernetes.io/projected/866d14fb-3176-40e7-96c3-a2b86118e929-kube-api-access-4wst5\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.725028 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.724997 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:29.787989 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.787958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:29.933216 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.933172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/866d14fb-3176-40e7-96c3-a2b86118e929-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:29.935715 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:29.935688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/866d14fb-3176-40e7-96c3-a2b86118e929-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6fm7f\" (UID: \"866d14fb-3176-40e7-96c3-a2b86118e929\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:30.112734 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:30.112700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" Jun 14 21:43:30.237317 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:30.237298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f"] Jun 14 21:43:30.239592 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:43:30.239553 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod866d14fb_3176_40e7_96c3_a2b86118e929.slice/crio-e8b0e4cf99eab1a657e5b6a7f0a0b2c56bc1b09fa32f904a3527b09c680ddf28 WatchSource:0}: Error finding container e8b0e4cf99eab1a657e5b6a7f0a0b2c56bc1b09fa32f904a3527b09c680ddf28: Status 404 returned error can't find the container with id e8b0e4cf99eab1a657e5b6a7f0a0b2c56bc1b09fa32f904a3527b09c680ddf28 Jun 14 21:43:30.354716 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:30.354677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" event={"ID":"866d14fb-3176-40e7-96c3-a2b86118e929","Type":"ContainerStarted","Data":"e8b0e4cf99eab1a657e5b6a7f0a0b2c56bc1b09fa32f904a3527b09c680ddf28"} Jun 14 21:43:32.926064 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:32.925941 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:33.926891 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:33.926864 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:43:33.926891 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:33.926876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:43:37.343590 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:37.343542 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:39.091644 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:39.091585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:39.925549 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:39.925509 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:41.099448 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.099410 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:41.728879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.728820 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c"] Jun 14 21:43:41.772418 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.772386 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c"] Jun 14 21:43:41.772607 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.772541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:41.775312 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.775292 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zmd4k\"" Jun 14 21:43:41.852134 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.852104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62271650-fa1c-472e-973b-1dcdbf29310e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7vj4c\" (UID: \"62271650-fa1c-472e-973b-1dcdbf29310e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:41.852319 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.852193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmpfs\" (UniqueName: \"kubernetes.io/projected/62271650-fa1c-472e-973b-1dcdbf29310e-kube-api-access-pmpfs\") pod \"kuadrant-operator-controller-manager-86878c769f-7vj4c\" (UID: \"62271650-fa1c-472e-973b-1dcdbf29310e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:41.953387 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.953351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62271650-fa1c-472e-973b-1dcdbf29310e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7vj4c\" (UID: \"62271650-fa1c-472e-973b-1dcdbf29310e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:41.953555 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.953461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmpfs\" (UniqueName: \"kubernetes.io/projected/62271650-fa1c-472e-973b-1dcdbf29310e-kube-api-access-pmpfs\") pod \"kuadrant-operator-controller-manager-86878c769f-7vj4c\" (UID: \"62271650-fa1c-472e-973b-1dcdbf29310e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:41.953784 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.953753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62271650-fa1c-472e-973b-1dcdbf29310e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7vj4c\" (UID: \"62271650-fa1c-472e-973b-1dcdbf29310e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:41.964639 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:41.964586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmpfs\" (UniqueName: \"kubernetes.io/projected/62271650-fa1c-472e-973b-1dcdbf29310e-kube-api-access-pmpfs\") pod \"kuadrant-operator-controller-manager-86878c769f-7vj4c\" (UID: \"62271650-fa1c-472e-973b-1dcdbf29310e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:42.085245 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:42.085207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:46.156160 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:46.156068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:46.251952 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:46.251916 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:50.496410 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:50.496385 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c"] Jun 14 21:43:50.497731 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:43:50.497704 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62271650_fa1c_472e_973b_1dcdbf29310e.slice/crio-9ef7bf30a21363f58326c994bbc9362a048cdc35a700873eb0df9293fe796420 WatchSource:0}: Error finding container 9ef7bf30a21363f58326c994bbc9362a048cdc35a700873eb0df9293fe796420: Status 404 returned error can't find the container with id 9ef7bf30a21363f58326c994bbc9362a048cdc35a700873eb0df9293fe796420 Jun 14 21:43:51.475313 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:51.475277 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" event={"ID":"62271650-fa1c-472e-973b-1dcdbf29310e","Type":"ContainerStarted","Data":"9ef7bf30a21363f58326c994bbc9362a048cdc35a700873eb0df9293fe796420"} Jun 14 21:43:51.477182 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:51.477119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" event={"ID":"866d14fb-3176-40e7-96c3-a2b86118e929","Type":"ContainerStarted","Data":"31bb324530dda56dae1370a2adaab2b96da9fbfa81f02be30ff7bcaab91a0b88"} Jun 14 21:43:51.493676 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:51.493628 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6fm7f" podStartSLOduration=2.296356337 podStartE2EDuration="22.493611783s" totalImagesPullingTime="20.197255446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:43:51.491074875 +0000 UTC m=+619.841694746" watchObservedRunningTime="2026-06-14 21:43:51.493611783 +0000 UTC m=+619.844231653" Jun 14 21:43:52.314122 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:52.314091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:52.417763 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:52.417724 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:52.538629 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:52.538590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:52.642630 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:52.642504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:54.334605 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:54.334532 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:54.436487 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:54.436443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:55.499809 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:55.499772 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" event={"ID":"62271650-fa1c-472e-973b-1dcdbf29310e","Type":"ContainerStarted","Data":"1178ef089b34af121ccc3ffd5f9e55b87b470393e4dc9783672af56701189e91"} Jun 14 21:43:55.500236 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:55.499854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:43:55.521032 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:55.520988 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" podStartSLOduration=10.101549676 podStartE2EDuration="14.52097472s" totalImagesPullingTime="4.419425044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:43:55.519270792 +0000 UTC m=+623.869890663" watchObservedRunningTime="2026-06-14 21:43:55.52097472 +0000 UTC m=+623.871594591" Jun 14 21:43:58.131138 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:58.131100 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:43:58.182253 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:43:58.182221 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:04.392029 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:04.391994 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:04.489782 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:04.489749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:06.506419 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:06.506386 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7vj4c" Jun 14 21:44:10.949366 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:10.949305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:11.047058 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:11.047015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:13.944458 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:13.944412 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:14.044819 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:14.044783 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:17.952812 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:17.952781 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:18.056446 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:18.056415 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:22.915558 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:22.915521 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:23.040618 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:23.040563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:24.555708 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:24.555672 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:24.655686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:24.655651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:24.755802 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:24.755767 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:25.353152 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.353118 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:25.418735 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.418699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:25.485590 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.485527 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:25.509643 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.509613 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8qpx4"] Jun 14 21:44:25.534538 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.534510 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8qpx4"] Jun 14 21:44:25.534700 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.534611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8qpx4" Jun 14 21:44:25.536769 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.536747 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dw7v7\"" Jun 14 21:44:25.662041 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.661958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zwkw\" (UniqueName: \"kubernetes.io/projected/3227661b-fbda-4efe-ae52-b33102ef6a98-kube-api-access-6zwkw\") pod \"authorino-75d556bd77-8qpx4\" (UID: \"3227661b-fbda-4efe-ae52-b33102ef6a98\") " pod="kuadrant-system/authorino-75d556bd77-8qpx4" Jun 14 21:44:25.763183 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.763152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zwkw\" (UniqueName: \"kubernetes.io/projected/3227661b-fbda-4efe-ae52-b33102ef6a98-kube-api-access-6zwkw\") pod \"authorino-75d556bd77-8qpx4\" (UID: \"3227661b-fbda-4efe-ae52-b33102ef6a98\") " pod="kuadrant-system/authorino-75d556bd77-8qpx4" Jun 14 21:44:25.770904 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.770869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zwkw\" (UniqueName: \"kubernetes.io/projected/3227661b-fbda-4efe-ae52-b33102ef6a98-kube-api-access-6zwkw\") pod \"authorino-75d556bd77-8qpx4\" (UID: \"3227661b-fbda-4efe-ae52-b33102ef6a98\") " pod="kuadrant-system/authorino-75d556bd77-8qpx4" Jun 14 21:44:25.843747 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.843725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8qpx4" Jun 14 21:44:25.969617 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:25.969594 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8qpx4"] Jun 14 21:44:25.972419 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:44:25.972392 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3227661b_fbda_4efe_ae52_b33102ef6a98.slice/crio-1c88b3a0f23e87b9cd7b157b31f093b3d7d8d857981235952adc591c2a9b7924 WatchSource:0}: Error finding container 1c88b3a0f23e87b9cd7b157b31f093b3d7d8d857981235952adc591c2a9b7924: Status 404 returned error can't find the container with id 1c88b3a0f23e87b9cd7b157b31f093b3d7d8d857981235952adc591c2a9b7924 Jun 14 21:44:26.647436 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:26.647373 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8qpx4" event={"ID":"3227661b-fbda-4efe-ae52-b33102ef6a98","Type":"ContainerStarted","Data":"1c88b3a0f23e87b9cd7b157b31f093b3d7d8d857981235952adc591c2a9b7924"} Jun 14 21:44:29.663342 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:29.663303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8qpx4" event={"ID":"3227661b-fbda-4efe-ae52-b33102ef6a98","Type":"ContainerStarted","Data":"37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773"} Jun 14 21:44:29.679052 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:29.679002 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8qpx4" podStartSLOduration=1.598470477 podStartE2EDuration="4.678988182s" totalImagesPullingTime="3.080517705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:44:29.677025423 +0000 UTC m=+658.027645304" watchObservedRunningTime="2026-06-14 21:44:29.678988182 +0000 UTC m=+658.029608052" Jun 14 21:44:30.624974 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:30.624939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:30.725777 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:30.725745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:31.161892 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:31.161856 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:31.260823 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:31.260785 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:34.172293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:34.172262 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:34.271877 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:34.271841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:39.055851 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:39.055813 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:39.113796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:39.113763 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:41.060320 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:41.060287 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:41.835743 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:41.835713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:41.936643 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:41.936607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:42.038634 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:42.038595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:51.028290 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:51.028257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:51.133085 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:51.133054 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:44:51.273974 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:44:51.273940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:19.361666 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.361614 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:19.462644 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.462610 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:19.769864 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.769837 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:45:19.772053 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.772032 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:19.774293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.774249 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 21:45:19.774389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.774311 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rf5hh\"" Jun 14 21:45:19.774389 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.774310 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 21:45:19.775163 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.775151 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 21:45:19.783646 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.783623 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:45:19.827718 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.827688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn5tw\" (UniqueName: \"kubernetes.io/projected/a4cd2a26-f7ac-484e-8f4e-19b054b13927-kube-api-access-rn5tw\") pod \"maas-keycloak-0\" (UID: \"a4cd2a26-f7ac-484e-8f4e-19b054b13927\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:19.928919 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.928888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn5tw\" (UniqueName: \"kubernetes.io/projected/a4cd2a26-f7ac-484e-8f4e-19b054b13927-kube-api-access-rn5tw\") pod \"maas-keycloak-0\" (UID: \"a4cd2a26-f7ac-484e-8f4e-19b054b13927\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:19.936563 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:19.936535 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn5tw\" (UniqueName: \"kubernetes.io/projected/a4cd2a26-f7ac-484e-8f4e-19b054b13927-kube-api-access-rn5tw\") pod \"maas-keycloak-0\" (UID: \"a4cd2a26-f7ac-484e-8f4e-19b054b13927\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:20.081260 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:20.081180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:20.210901 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:20.210876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:45:20.212996 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:45:20.212969 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cd2a26_f7ac_484e_8f4e_19b054b13927.slice/crio-679836155ab5b4eb281791e34127f6b859b01d63a4b47700fcf0a4cc46564f61 WatchSource:0}: Error finding container 679836155ab5b4eb281791e34127f6b859b01d63a4b47700fcf0a4cc46564f61: Status 404 returned error can't find the container with id 679836155ab5b4eb281791e34127f6b859b01d63a4b47700fcf0a4cc46564f61 Jun 14 21:45:20.897125 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:20.897025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4cd2a26-f7ac-484e-8f4e-19b054b13927","Type":"ContainerStarted","Data":"679836155ab5b4eb281791e34127f6b859b01d63a4b47700fcf0a4cc46564f61"} Jun 14 21:45:24.924149 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:24.924048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4cd2a26-f7ac-484e-8f4e-19b054b13927","Type":"ContainerStarted","Data":"06393330e597cf9f8c0f922d9e98a0be79066d458c4ec15733e4afc841e906b4"} Jun 14 21:45:24.943160 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:24.943093 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.535819657 podStartE2EDuration="5.943068798s" totalImagesPullingTime="4.407249141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:45:24.93978701 +0000 UTC m=+713.290406882" watchObservedRunningTime="2026-06-14 21:45:24.943068798 +0000 UTC m=+713.293688672" Jun 14 21:45:25.081624 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:25.081589 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:25.083090 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:25.083056 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:26.081861 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:26.081805 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:27.082192 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:27.082144 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:28.082301 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:28.082252 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:29.082264 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:29.082204 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:30.090496 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:30.089897 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:30.106231 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:30.106193 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:31.081637 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:31.081563 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:32.081610 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:32.081550 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:33.082044 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:33.081998 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:34.081609 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:34.081543 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:35.081879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:35.081827 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:36.082333 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:36.082289 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:37.082139 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:37.082096 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.27:9000/health/started\": dial tcp 10.134.0.27:9000: connect: connection refused" Jun 14 21:45:38.213822 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:38.213772 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:38.231459 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:38.231389 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:45:48.220847 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:48.220817 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 21:45:48.878618 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:48.878566 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:48.978440 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:48.978402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:50.411644 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:50.411612 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:50.465224 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:50.465191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:51.153585 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:51.153536 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8qpx4"] Jun 14 21:45:51.153761 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:51.153713 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8qpx4" podUID="3227661b-fbda-4efe-ae52-b33102ef6a98" containerName="authorino" containerID="cri-o://37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773" gracePeriod=30 Jun 14 21:45:51.402011 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:51.401984 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8qpx4" Jun 14 21:45:51.431440 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:51.431365 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zwkw\" (UniqueName: \"kubernetes.io/projected/3227661b-fbda-4efe-ae52-b33102ef6a98-kube-api-access-6zwkw\") pod \"3227661b-fbda-4efe-ae52-b33102ef6a98\" (UID: \"3227661b-fbda-4efe-ae52-b33102ef6a98\") " Jun 14 21:45:51.433730 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:51.433697 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3227661b-fbda-4efe-ae52-b33102ef6a98-kube-api-access-6zwkw" (OuterVolumeSpecName: "kube-api-access-6zwkw") pod "3227661b-fbda-4efe-ae52-b33102ef6a98" (UID: "3227661b-fbda-4efe-ae52-b33102ef6a98"). InnerVolumeSpecName "kube-api-access-6zwkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:45:51.532936 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:51.532897 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zwkw\" (UniqueName: \"kubernetes.io/projected/3227661b-fbda-4efe-ae52-b33102ef6a98-kube-api-access-6zwkw\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:45:52.093049 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.093012 2562 generic.go:356] "Generic (PLEG): container finished" podID="3227661b-fbda-4efe-ae52-b33102ef6a98" containerID="37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773" exitCode=0 Jun 14 21:45:52.093246 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.093084 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8qpx4" Jun 14 21:45:52.093246 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.093133 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8qpx4" event={"ID":"3227661b-fbda-4efe-ae52-b33102ef6a98","Type":"ContainerDied","Data":"37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773"} Jun 14 21:45:52.093246 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.093168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8qpx4" event={"ID":"3227661b-fbda-4efe-ae52-b33102ef6a98","Type":"ContainerDied","Data":"1c88b3a0f23e87b9cd7b157b31f093b3d7d8d857981235952adc591c2a9b7924"} Jun 14 21:45:52.093246 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.093189 2562 scope.go:117] "RemoveContainer" containerID="37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773" Jun 14 21:45:52.102079 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.102062 2562 scope.go:117] "RemoveContainer" containerID="37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773" Jun 14 21:45:52.102342 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:45:52.102323 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773\": container with ID starting with 37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773 not found: ID does not exist" containerID="37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773" Jun 14 21:45:52.102402 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.102348 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773"} err="failed to get container status \"37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773\": rpc error: code = NotFound desc = could not find container \"37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773\": container with ID starting with 37f50c1cfa4314796ddc8eef0068fb4e3f87acfa692abba9be82092fa9c93773 not found: ID does not exist" Jun 14 21:45:52.107769 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.107748 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8qpx4"] Jun 14 21:45:52.111258 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:52.111240 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8qpx4"] Jun 14 21:45:54.081695 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.081663 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3227661b-fbda-4efe-ae52-b33102ef6a98" path="/var/lib/kubelet/pods/3227661b-fbda-4efe-ae52-b33102ef6a98/volumes" Jun 14 21:45:54.614371 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.614340 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:54.650292 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.650259 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-dbstj"] Jun 14 21:45:54.650677 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.650662 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3227661b-fbda-4efe-ae52-b33102ef6a98" containerName="authorino" Jun 14 21:45:54.650731 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.650679 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3227661b-fbda-4efe-ae52-b33102ef6a98" containerName="authorino" Jun 14 21:45:54.650772 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.650738 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3227661b-fbda-4efe-ae52-b33102ef6a98" containerName="authorino" Jun 14 21:45:54.655042 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.655020 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:54.659943 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.659918 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 21:45:54.660289 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.660268 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 21:45:54.660391 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.660345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gqqgf\"" Jun 14 21:45:54.690167 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.690139 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-dbstj"] Jun 14 21:45:54.762019 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.761982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-webhook-cert\") pod \"maas-controller-6bc9b988dc-dbstj\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:54.762195 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.762025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fphhj\" (UniqueName: \"kubernetes.io/projected/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-kube-api-access-fphhj\") pod \"maas-controller-6bc9b988dc-dbstj\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:54.787015 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.786989 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:54.844321 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.844287 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c865b7554-46g2d"] Jun 14 21:45:54.847674 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.847653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:54.858343 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.858319 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c865b7554-46g2d"] Jun 14 21:45:54.863329 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.863305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-webhook-cert\") pod \"maas-controller-6bc9b988dc-dbstj\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:54.863431 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.863345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fphhj\" (UniqueName: \"kubernetes.io/projected/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-kube-api-access-fphhj\") pod \"maas-controller-6bc9b988dc-dbstj\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:54.865090 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.865014 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:54.865884 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.865865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-webhook-cert\") pod \"maas-controller-6bc9b988dc-dbstj\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:54.876954 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.876928 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fphhj\" (UniqueName: \"kubernetes.io/projected/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-kube-api-access-fphhj\") pod \"maas-controller-6bc9b988dc-dbstj\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:54.964078 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.964039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47ee859f-3b66-4493-8b68-b32742ff7dcd-webhook-cert\") pod \"maas-controller-7c865b7554-46g2d\" (UID: \"47ee859f-3b66-4493-8b68-b32742ff7dcd\") " pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:54.964250 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.964115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwzkq\" (UniqueName: \"kubernetes.io/projected/47ee859f-3b66-4493-8b68-b32742ff7dcd-kube-api-access-xwzkq\") pod \"maas-controller-7c865b7554-46g2d\" (UID: \"47ee859f-3b66-4493-8b68-b32742ff7dcd\") " pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:54.964906 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:54.964883 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:55.065229 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:55.065194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47ee859f-3b66-4493-8b68-b32742ff7dcd-webhook-cert\") pod \"maas-controller-7c865b7554-46g2d\" (UID: \"47ee859f-3b66-4493-8b68-b32742ff7dcd\") " pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:55.065403 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:55.065306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwzkq\" (UniqueName: \"kubernetes.io/projected/47ee859f-3b66-4493-8b68-b32742ff7dcd-kube-api-access-xwzkq\") pod \"maas-controller-7c865b7554-46g2d\" (UID: \"47ee859f-3b66-4493-8b68-b32742ff7dcd\") " pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:55.068687 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:55.068482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47ee859f-3b66-4493-8b68-b32742ff7dcd-webhook-cert\") pod \"maas-controller-7c865b7554-46g2d\" (UID: \"47ee859f-3b66-4493-8b68-b32742ff7dcd\") " pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:55.074984 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:55.074903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwzkq\" (UniqueName: \"kubernetes.io/projected/47ee859f-3b66-4493-8b68-b32742ff7dcd-kube-api-access-xwzkq\") pod \"maas-controller-7c865b7554-46g2d\" (UID: \"47ee859f-3b66-4493-8b68-b32742ff7dcd\") " pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:55.101553 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:55.101508 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-dbstj"] Jun 14 21:45:55.105611 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:45:55.105582 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4d885b_287d_4de3_8ba3_8668fc88c7cd.slice/crio-f38fa610e95a6b0205b5189c5d4871a61d9cd194f588d61ab9dc31609dd5ecb3 WatchSource:0}: Error finding container f38fa610e95a6b0205b5189c5d4871a61d9cd194f588d61ab9dc31609dd5ecb3: Status 404 returned error can't find the container with id f38fa610e95a6b0205b5189c5d4871a61d9cd194f588d61ab9dc31609dd5ecb3 Jun 14 21:45:55.158731 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:55.158647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:55.286071 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:55.286050 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c865b7554-46g2d"] Jun 14 21:45:55.288089 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:45:55.288060 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ee859f_3b66_4493_8b68_b32742ff7dcd.slice/crio-b79866c8603bf44fa5687dc94a132d74ba79e947ac0e207cbe3eff701dac40b6 WatchSource:0}: Error finding container b79866c8603bf44fa5687dc94a132d74ba79e947ac0e207cbe3eff701dac40b6: Status 404 returned error can't find the container with id b79866c8603bf44fa5687dc94a132d74ba79e947ac0e207cbe3eff701dac40b6 Jun 14 21:45:56.117795 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:56.117756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" event={"ID":"6e4d885b-287d-4de3-8ba3-8668fc88c7cd","Type":"ContainerStarted","Data":"f38fa610e95a6b0205b5189c5d4871a61d9cd194f588d61ab9dc31609dd5ecb3"} Jun 14 21:45:56.118778 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:56.118754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c865b7554-46g2d" event={"ID":"47ee859f-3b66-4493-8b68-b32742ff7dcd","Type":"ContainerStarted","Data":"b79866c8603bf44fa5687dc94a132d74ba79e947ac0e207cbe3eff701dac40b6"} Jun 14 21:45:57.125292 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:57.125246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c865b7554-46g2d" event={"ID":"47ee859f-3b66-4493-8b68-b32742ff7dcd","Type":"ContainerStarted","Data":"3d94aeec80b37fd4ba255743032d02dbfe186e9cf924d874010e98f1f36b8877"} Jun 14 21:45:57.125776 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:57.125371 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:45:57.126744 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:57.126719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" event={"ID":"6e4d885b-287d-4de3-8ba3-8668fc88c7cd","Type":"ContainerStarted","Data":"947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331"} Jun 14 21:45:57.126870 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:57.126855 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:45:57.142425 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:57.142377 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c865b7554-46g2d" podStartSLOduration=1.446412707 podStartE2EDuration="3.142359605s" totalImagesPullingTime="1.695946898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:45:57.141902208 +0000 UTC m=+745.492522075" watchObservedRunningTime="2026-06-14 21:45:57.142359605 +0000 UTC m=+745.492979526" Jun 14 21:45:57.226835 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:57.226796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:45:57.322251 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:45:57.322210 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:46:08.136821 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.136783 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c865b7554-46g2d" Jun 14 21:46:08.137313 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.136874 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:46:08.153360 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.153301 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" podStartSLOduration=12.270921022 podStartE2EDuration="14.153283936s" totalImagesPullingTime="1.882362914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:45:57.156315373 +0000 UTC m=+745.506935280" watchObservedRunningTime="2026-06-14 21:46:08.153283936 +0000 UTC m=+756.503903808" Jun 14 21:46:08.194731 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.194696 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-dbstj"] Jun 14 21:46:08.194926 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.194888 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" podUID="6e4d885b-287d-4de3-8ba3-8668fc88c7cd" containerName="manager" containerID="cri-o://947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331" gracePeriod=30 Jun 14 21:46:08.444802 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.444313 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:46:08.591815 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.591786 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fphhj\" (UniqueName: \"kubernetes.io/projected/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-kube-api-access-fphhj\") pod \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " Jun 14 21:46:08.591815 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.591824 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-webhook-cert\") pod \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\" (UID: \"6e4d885b-287d-4de3-8ba3-8668fc88c7cd\") " Jun 14 21:46:08.594106 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.594071 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-kube-api-access-fphhj" (OuterVolumeSpecName: "kube-api-access-fphhj") pod "6e4d885b-287d-4de3-8ba3-8668fc88c7cd" (UID: "6e4d885b-287d-4de3-8ba3-8668fc88c7cd"). InnerVolumeSpecName "kube-api-access-fphhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:46:08.594217 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.594123 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6e4d885b-287d-4de3-8ba3-8668fc88c7cd" (UID: "6e4d885b-287d-4de3-8ba3-8668fc88c7cd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 21:46:08.693416 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.693346 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fphhj\" (UniqueName: \"kubernetes.io/projected/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-kube-api-access-fphhj\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:46:08.693416 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:08.693370 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e4d885b-287d-4de3-8ba3-8668fc88c7cd-webhook-cert\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:46:09.184527 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.184482 2562 generic.go:356] "Generic (PLEG): container finished" podID="6e4d885b-287d-4de3-8ba3-8668fc88c7cd" containerID="947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331" exitCode=0 Jun 14 21:46:09.184527 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.184528 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" Jun 14 21:46:09.185065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.184542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" event={"ID":"6e4d885b-287d-4de3-8ba3-8668fc88c7cd","Type":"ContainerDied","Data":"947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331"} Jun 14 21:46:09.185065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.184607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9b988dc-dbstj" event={"ID":"6e4d885b-287d-4de3-8ba3-8668fc88c7cd","Type":"ContainerDied","Data":"f38fa610e95a6b0205b5189c5d4871a61d9cd194f588d61ab9dc31609dd5ecb3"} Jun 14 21:46:09.185065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.184630 2562 scope.go:117] "RemoveContainer" containerID="947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331" Jun 14 21:46:09.194315 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.194299 2562 scope.go:117] "RemoveContainer" containerID="947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331" Jun 14 21:46:09.194602 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:46:09.194565 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331\": container with ID starting with 947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331 not found: ID does not exist" containerID="947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331" Jun 14 21:46:09.194651 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.194610 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331"} err="failed to get container status \"947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331\": rpc error: code = NotFound desc = could not find container \"947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331\": container with ID starting with 947f9c667e0edb175bcc66b868c5175eee91598c1e2b35d54783ecca8d58f331 not found: ID does not exist" Jun 14 21:46:09.207283 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.206380 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-dbstj"] Jun 14 21:46:09.212932 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:09.212908 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bc9b988dc-dbstj"] Jun 14 21:46:10.080945 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:10.080910 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e4d885b-287d-4de3-8ba3-8668fc88c7cd" path="/var/lib/kubelet/pods/6e4d885b-287d-4de3-8ba3-8668fc88c7cd/volumes" Jun 14 21:46:28.336047 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.335984 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:46:28.385724 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.385688 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-79d5d876dc-cpjhr"] Jun 14 21:46:28.386084 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.386072 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4d885b-287d-4de3-8ba3-8668fc88c7cd" containerName="manager" Jun 14 21:46:28.386127 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.386086 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4d885b-287d-4de3-8ba3-8668fc88c7cd" containerName="manager" Jun 14 21:46:28.386188 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.386179 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e4d885b-287d-4de3-8ba3-8668fc88c7cd" containerName="manager" Jun 14 21:46:28.392191 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.392166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.394343 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.394314 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 21:46:28.394463 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.394361 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6xfn8\"" Jun 14 21:46:28.399351 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.399323 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-79d5d876dc-cpjhr"] Jun 14 21:46:28.460142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.460107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e7fd56-a6d9-445f-8e7c-9703de475131-maas-api-tls\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.460313 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.460151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e7fd56-a6d9-445f-8e7c-9703de475131-openshift-service-ca\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.460313 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.460197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkl2c\" (UniqueName: \"kubernetes.io/projected/91e7fd56-a6d9-445f-8e7c-9703de475131-kube-api-access-dkl2c\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.560646 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.560609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e7fd56-a6d9-445f-8e7c-9703de475131-openshift-service-ca\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.560835 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.560657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkl2c\" (UniqueName: \"kubernetes.io/projected/91e7fd56-a6d9-445f-8e7c-9703de475131-kube-api-access-dkl2c\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.560835 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.560749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e7fd56-a6d9-445f-8e7c-9703de475131-maas-api-tls\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.560921 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:46:28.560834 2562 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 14 21:46:28.560921 ip-10-0-128-159 kubenswrapper[2562]: E0614 21:46:28.560911 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91e7fd56-a6d9-445f-8e7c-9703de475131-maas-api-tls podName:91e7fd56-a6d9-445f-8e7c-9703de475131 nodeName:}" failed. No retries permitted until 2026-06-14 21:46:29.060894065 +0000 UTC m=+777.411513914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91e7fd56-a6d9-445f-8e7c-9703de475131-maas-api-tls") pod "maas-api-79d5d876dc-cpjhr" (UID: "91e7fd56-a6d9-445f-8e7c-9703de475131") : secret "maas-api-serving-cert" not found Jun 14 21:46:28.561245 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.561220 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e7fd56-a6d9-445f-8e7c-9703de475131-openshift-service-ca\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.568914 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.568891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkl2c\" (UniqueName: \"kubernetes.io/projected/91e7fd56-a6d9-445f-8e7c-9703de475131-kube-api-access-dkl2c\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:28.751061 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.750966 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:46:28.848200 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.848160 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:46:28.853561 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.853536 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-vbktm"] Jun 14 21:46:28.858063 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.858041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" Jun 14 21:46:28.860394 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.860373 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6wh7n\"" Jun 14 21:46:28.860506 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.860420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 21:46:28.862482 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.862455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx25m\" (UniqueName: \"kubernetes.io/projected/3734494e-cf95-4c65-8d48-7fa25aab9668-kube-api-access-zx25m\") pod \"payload-pre-processing-579785bc64-vbktm\" (UID: \"3734494e-cf95-4c65-8d48-7fa25aab9668\") " pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" Jun 14 21:46:28.868919 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.868899 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-vbktm"] Jun 14 21:46:28.921304 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.921269 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:46:28.963421 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.963389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx25m\" (UniqueName: \"kubernetes.io/projected/3734494e-cf95-4c65-8d48-7fa25aab9668-kube-api-access-zx25m\") pod \"payload-pre-processing-579785bc64-vbktm\" (UID: \"3734494e-cf95-4c65-8d48-7fa25aab9668\") " pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" Jun 14 21:46:28.971323 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:28.971286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx25m\" (UniqueName: \"kubernetes.io/projected/3734494e-cf95-4c65-8d48-7fa25aab9668-kube-api-access-zx25m\") pod \"payload-pre-processing-579785bc64-vbktm\" (UID: \"3734494e-cf95-4c65-8d48-7fa25aab9668\") " pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" Jun 14 21:46:29.064049 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:29.064014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e7fd56-a6d9-445f-8e7c-9703de475131-maas-api-tls\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:29.066466 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:29.066434 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e7fd56-a6d9-445f-8e7c-9703de475131-maas-api-tls\") pod \"maas-api-79d5d876dc-cpjhr\" (UID: \"91e7fd56-a6d9-445f-8e7c-9703de475131\") " pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:29.169853 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:29.169817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" Jun 14 21:46:29.304344 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:29.304311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:29.308370 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:29.308348 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-vbktm"] Jun 14 21:46:29.313340 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:46:29.313307 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3734494e_cf95_4c65_8d48_7fa25aab9668.slice/crio-3e2e854d7d0f74e0ed38d9f8b4be47e487f31f05acdfa13bea86bc3550a8b3d7 WatchSource:0}: Error finding container 3e2e854d7d0f74e0ed38d9f8b4be47e487f31f05acdfa13bea86bc3550a8b3d7: Status 404 returned error can't find the container with id 3e2e854d7d0f74e0ed38d9f8b4be47e487f31f05acdfa13bea86bc3550a8b3d7 Jun 14 21:46:29.315270 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:29.315253 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 21:46:29.448947 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:29.448788 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-79d5d876dc-cpjhr"] Jun 14 21:46:29.451651 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:46:29.451622 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e7fd56_a6d9_445f_8e7c_9703de475131.slice/crio-de7c7b8e27b092e735e1bd47ed1a963e15174cebba74998b41ce4e774a77a112 WatchSource:0}: Error finding container de7c7b8e27b092e735e1bd47ed1a963e15174cebba74998b41ce4e774a77a112: Status 404 returned error can't find the container with id de7c7b8e27b092e735e1bd47ed1a963e15174cebba74998b41ce4e774a77a112 Jun 14 21:46:30.293890 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:30.293846 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-79d5d876dc-cpjhr" event={"ID":"91e7fd56-a6d9-445f-8e7c-9703de475131","Type":"ContainerStarted","Data":"de7c7b8e27b092e735e1bd47ed1a963e15174cebba74998b41ce4e774a77a112"} Jun 14 21:46:30.295427 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:30.295394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" event={"ID":"3734494e-cf95-4c65-8d48-7fa25aab9668","Type":"ContainerStarted","Data":"3e2e854d7d0f74e0ed38d9f8b4be47e487f31f05acdfa13bea86bc3550a8b3d7"} Jun 14 21:46:32.306527 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:32.306496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-79d5d876dc-cpjhr" event={"ID":"91e7fd56-a6d9-445f-8e7c-9703de475131","Type":"ContainerStarted","Data":"45ddf198148e248475597971a302926dfa0cb8a328a9fd3ec122b40852e21033"} Jun 14 21:46:32.306969 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:32.306664 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:32.307915 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:32.307892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" event={"ID":"3734494e-cf95-4c65-8d48-7fa25aab9668","Type":"ContainerStarted","Data":"a0b6987e53f5d6bfdfebadd2b4697b0b3c4454e16761aaa0912d1c0fecc58129"} Jun 14 21:46:32.308094 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:32.308076 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" Jun 14 21:46:32.323711 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:32.323674 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-79d5d876dc-cpjhr" podStartSLOduration=2.040449738 podStartE2EDuration="4.32366269s" totalImagesPullingTime="2.283212952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:46:32.321469485 +0000 UTC m=+780.672089368" watchObservedRunningTime="2026-06-14 21:46:32.32366269 +0000 UTC m=+780.674282561" Jun 14 21:46:32.335971 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:32.335932 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" podStartSLOduration=1.866495568 podStartE2EDuration="4.335920517s" totalImagesPullingTime="2.469424949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:46:32.33482466 +0000 UTC m=+780.685444530" watchObservedRunningTime="2026-06-14 21:46:32.335920517 +0000 UTC m=+780.686540388" Jun 14 21:46:38.318890 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:38.318854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-79d5d876dc-cpjhr" Jun 14 21:46:39.545024 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:39.544991 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:46:39.545540 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:39.545207 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" containerID="cri-o://06393330e597cf9f8c0f922d9e98a0be79066d458c4ec15733e4afc841e906b4" gracePeriod=30 Jun 14 21:46:41.357566 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:41.357533 2562 generic.go:356] "Generic (PLEG): container finished" podID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerID="06393330e597cf9f8c0f922d9e98a0be79066d458c4ec15733e4afc841e906b4" exitCode=143 Jun 14 21:46:41.357955 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:41.357610 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4cd2a26-f7ac-484e-8f4e-19b054b13927","Type":"ContainerDied","Data":"06393330e597cf9f8c0f922d9e98a0be79066d458c4ec15733e4afc841e906b4"} Jun 14 21:46:41.598939 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:41.598912 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:41.687742 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:41.687666 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn5tw\" (UniqueName: \"kubernetes.io/projected/a4cd2a26-f7ac-484e-8f4e-19b054b13927-kube-api-access-rn5tw\") pod \"a4cd2a26-f7ac-484e-8f4e-19b054b13927\" (UID: \"a4cd2a26-f7ac-484e-8f4e-19b054b13927\") " Jun 14 21:46:41.689874 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:41.689852 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4cd2a26-f7ac-484e-8f4e-19b054b13927-kube-api-access-rn5tw" (OuterVolumeSpecName: "kube-api-access-rn5tw") pod "a4cd2a26-f7ac-484e-8f4e-19b054b13927" (UID: "a4cd2a26-f7ac-484e-8f4e-19b054b13927"). InnerVolumeSpecName "kube-api-access-rn5tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:46:41.789043 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:41.789006 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn5tw\" (UniqueName: \"kubernetes.io/projected/a4cd2a26-f7ac-484e-8f4e-19b054b13927-kube-api-access-rn5tw\") on node \"ip-10-0-128-159.ec2.internal\" DevicePath \"\"" Jun 14 21:46:42.363767 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.363681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4cd2a26-f7ac-484e-8f4e-19b054b13927","Type":"ContainerDied","Data":"679836155ab5b4eb281791e34127f6b859b01d63a4b47700fcf0a4cc46564f61"} Jun 14 21:46:42.363767 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.363736 2562 scope.go:117] "RemoveContainer" containerID="06393330e597cf9f8c0f922d9e98a0be79066d458c4ec15733e4afc841e906b4" Jun 14 21:46:42.364214 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.363690 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.380023 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.379996 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:46:42.382234 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.382215 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:46:42.401532 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.401503 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:46:42.401906 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.401892 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" Jun 14 21:46:42.401950 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.401907 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" Jun 14 21:46:42.401990 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.401982 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" containerName="keycloak" Jun 14 21:46:42.406367 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.406350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.408686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.408666 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 21:46:42.408769 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.408709 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 21:46:42.408769 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.408735 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rf5hh\"" Jun 14 21:46:42.408864 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.408780 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 14 21:46:42.408864 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.408857 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 21:46:42.416015 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.415996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:46:42.494150 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.494113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/14614711-99f7-4928-97b6-09a51ba41f0e-test-realms\") pod \"maas-keycloak-0\" (UID: \"14614711-99f7-4928-97b6-09a51ba41f0e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.494150 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.494144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jmf\" (UniqueName: \"kubernetes.io/projected/14614711-99f7-4928-97b6-09a51ba41f0e-kube-api-access-q9jmf\") pod \"maas-keycloak-0\" (UID: \"14614711-99f7-4928-97b6-09a51ba41f0e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.595660 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.595626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/14614711-99f7-4928-97b6-09a51ba41f0e-test-realms\") pod \"maas-keycloak-0\" (UID: \"14614711-99f7-4928-97b6-09a51ba41f0e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.595660 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.595661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jmf\" (UniqueName: \"kubernetes.io/projected/14614711-99f7-4928-97b6-09a51ba41f0e-kube-api-access-q9jmf\") pod \"maas-keycloak-0\" (UID: \"14614711-99f7-4928-97b6-09a51ba41f0e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.596335 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.596313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/14614711-99f7-4928-97b6-09a51ba41f0e-test-realms\") pod \"maas-keycloak-0\" (UID: \"14614711-99f7-4928-97b6-09a51ba41f0e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.604111 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.604085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jmf\" (UniqueName: \"kubernetes.io/projected/14614711-99f7-4928-97b6-09a51ba41f0e-kube-api-access-q9jmf\") pod \"maas-keycloak-0\" (UID: \"14614711-99f7-4928-97b6-09a51ba41f0e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.716749 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.716662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:42.851528 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:42.851504 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 21:46:42.853886 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:46:42.853853 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14614711_99f7_4928_97b6_09a51ba41f0e.slice/crio-69abb5bda5cbf4b108f78637b9671eed82f809f9e68cc166a07e280e458e53c8 WatchSource:0}: Error finding container 69abb5bda5cbf4b108f78637b9671eed82f809f9e68cc166a07e280e458e53c8: Status 404 returned error can't find the container with id 69abb5bda5cbf4b108f78637b9671eed82f809f9e68cc166a07e280e458e53c8 Jun 14 21:46:43.315532 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:43.315510 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-vbktm" Jun 14 21:46:43.372620 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:43.372586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"14614711-99f7-4928-97b6-09a51ba41f0e","Type":"ContainerStarted","Data":"ac6a156cfbc25e30241a8a2baa56940f065c851a2f92f808cb2a5f9486aaf144"} Jun 14 21:46:43.373081 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:43.372636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"14614711-99f7-4928-97b6-09a51ba41f0e","Type":"ContainerStarted","Data":"69abb5bda5cbf4b108f78637b9671eed82f809f9e68cc166a07e280e458e53c8"} Jun 14 21:46:43.390540 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:43.390493 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.001493538 podStartE2EDuration="1.390476739s" totalImagesPullingTime="388.983201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:46:43.388825038 +0000 UTC m=+791.739444912" watchObservedRunningTime="2026-06-14 21:46:43.390476739 +0000 UTC m=+791.741096609" Jun 14 21:46:43.717058 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:43.717014 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:43.718448 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:43.718404 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:44.082969 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:44.082919 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4cd2a26-f7ac-484e-8f4e-19b054b13927" path="/var/lib/kubelet/pods/a4cd2a26-f7ac-484e-8f4e-19b054b13927/volumes" Jun 14 21:46:44.717414 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:44.717346 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:45.717630 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:45.717509 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:46.717481 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:46.717425 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:47.717624 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:47.717558 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:48.717761 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:48.717702 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:49.717731 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:49.717680 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:50.717689 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:50.717631 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:51.717274 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:51.717219 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:52.717445 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:52.717387 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:52.717980 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:52.717766 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:53.717373 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:53.717327 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:54.717873 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:54.717819 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:55.718006 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:55.717953 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 14 21:46:56.845781 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:56.845745 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 21:46:56.864442 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:46:56.864401 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="14614711-99f7-4928-97b6-09a51ba41f0e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:47:06.851659 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:06.851613 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 21:47:19.305214 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:19.305174 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:47:19.404964 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:19.404927 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:47:25.179844 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.179806 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm"] Jun 14 21:47:25.183773 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.183746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.186130 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.186103 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 21:47:25.186923 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.186898 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b9vm5\"" Jun 14 21:47:25.186923 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.186911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 14 21:47:25.187090 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.186919 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 21:47:25.194216 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.194190 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm"] Jun 14 21:47:25.216462 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.216418 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:47:25.303709 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.303665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.303879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.303720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.303879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.303791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4231420-c7a3-4622-80f5-9cc05882155c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.303879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.303850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphj8\" (UniqueName: \"kubernetes.io/projected/d4231420-c7a3-4622-80f5-9cc05882155c-kube-api-access-tphj8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.303879 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.303875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.304015 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.303893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.404997 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.404956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4231420-c7a3-4622-80f5-9cc05882155c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405176 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphj8\" (UniqueName: \"kubernetes.io/projected/d4231420-c7a3-4622-80f5-9cc05882155c-kube-api-access-tphj8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405176 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405176 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405176 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405176 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405670 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405726 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.405763 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.405711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.407548 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.407524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4231420-c7a3-4622-80f5-9cc05882155c-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.407842 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.407822 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4231420-c7a3-4622-80f5-9cc05882155c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.413142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.413109 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphj8\" (UniqueName: \"kubernetes.io/projected/d4231420-c7a3-4622-80f5-9cc05882155c-kube-api-access-tphj8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm\" (UID: \"d4231420-c7a3-4622-80f5-9cc05882155c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.496406 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.496309 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:47:25.641179 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:25.641141 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm"] Jun 14 21:47:25.643721 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:47:25.643697 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4231420_c7a3_4622_80f5_9cc05882155c.slice/crio-ea982e990bf0682138b22d76a32e05df2eee98879c57215f42228905ddd2c329 WatchSource:0}: Error finding container ea982e990bf0682138b22d76a32e05df2eee98879c57215f42228905ddd2c329: Status 404 returned error can't find the container with id ea982e990bf0682138b22d76a32e05df2eee98879c57215f42228905ddd2c329 Jun 14 21:47:26.631010 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:26.630979 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" event={"ID":"d4231420-c7a3-4622-80f5-9cc05882155c","Type":"ContainerStarted","Data":"ea982e990bf0682138b22d76a32e05df2eee98879c57215f42228905ddd2c329"} Jun 14 21:47:29.649241 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:29.649202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" event={"ID":"d4231420-c7a3-4622-80f5-9cc05882155c","Type":"ContainerStarted","Data":"d1aa1c665bbcfef6ea0dcd14fd93da14cddaee218b84511e743f741cf7c6694a"} Jun 14 21:47:34.296662 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:34.296623 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:47:41.647832 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.647797 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z"] Jun 14 21:47:41.653257 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.653233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.656440 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.656418 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 14 21:47:41.663550 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.663524 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z"] Jun 14 21:47:41.679194 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.679165 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:47:41.760692 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.760660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr5tg\" (UniqueName: \"kubernetes.io/projected/8a157606-dd41-4a53-ab1a-724de21d55ae-kube-api-access-xr5tg\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.760849 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.760709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.760849 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.760818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.760931 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.760853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.760967 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.760959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.761004 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.760980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a157606-dd41-4a53-ab1a-724de21d55ae-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862042 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.861996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862196 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862196 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862196 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a157606-dd41-4a53-ab1a-724de21d55ae-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862334 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5tg\" (UniqueName: \"kubernetes.io/projected/8a157606-dd41-4a53-ab1a-724de21d55ae-kube-api-access-xr5tg\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862334 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862472 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862684 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862485 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.862782 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.862609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.864383 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.864357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a157606-dd41-4a53-ab1a-724de21d55ae-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.864790 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.864768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a157606-dd41-4a53-ab1a-724de21d55ae-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.870418 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.870385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr5tg\" (UniqueName: \"kubernetes.io/projected/8a157606-dd41-4a53-ab1a-724de21d55ae-kube-api-access-xr5tg\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z\" (UID: \"8a157606-dd41-4a53-ab1a-724de21d55ae\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:41.965657 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:41.965555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:47:42.102918 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:42.102892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z"] Jun 14 21:47:42.104720 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:47:42.104691 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a157606_dd41_4a53_ab1a_724de21d55ae.slice/crio-dbbc11f205b5b824d2ba04368595c19580cb0ad999dd8051e1f5e0f6065d6b6e WatchSource:0}: Error finding container dbbc11f205b5b824d2ba04368595c19580cb0ad999dd8051e1f5e0f6065d6b6e: Status 404 returned error can't find the container with id dbbc11f205b5b824d2ba04368595c19580cb0ad999dd8051e1f5e0f6065d6b6e Jun 14 21:47:42.713378 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:42.713339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" event={"ID":"8a157606-dd41-4a53-ab1a-724de21d55ae","Type":"ContainerStarted","Data":"56c13db44823b5aad1680f17e81723b559516b829ba7e5d323ac9644b27b2b28"} Jun 14 21:47:42.713835 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:42.713395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" event={"ID":"8a157606-dd41-4a53-ab1a-724de21d55ae","Type":"ContainerStarted","Data":"dbbc11f205b5b824d2ba04368595c19580cb0ad999dd8051e1f5e0f6065d6b6e"} Jun 14 21:47:45.769523 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.769487 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb"] Jun 14 21:47:45.774856 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.774836 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.777056 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.777035 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 14 21:47:45.782833 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.782807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb"] Jun 14 21:47:45.793196 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.793153 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:47:45.896014 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.895978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40eabb08-c880-4b5f-9624-c3843ab8a753-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.896178 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.896042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.896178 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.896133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.896178 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.896174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7qg2\" (UniqueName: \"kubernetes.io/projected/40eabb08-c880-4b5f-9624-c3843ab8a753-kube-api-access-x7qg2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.896293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.896196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.896293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.896217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.996779 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.996739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.996972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.996790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.996972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.996824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7qg2\" (UniqueName: \"kubernetes.io/projected/40eabb08-c880-4b5f-9624-c3843ab8a753-kube-api-access-x7qg2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.996972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.996878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.996972 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.996906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.997180 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.996979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40eabb08-c880-4b5f-9624-c3843ab8a753-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.997233 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.997177 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.997288 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.997236 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.997346 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.997286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.999032 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.999010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40eabb08-c880-4b5f-9624-c3843ab8a753-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:45.999314 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:45.999296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40eabb08-c880-4b5f-9624-c3843ab8a753-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:46.003742 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:46.003721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7qg2\" (UniqueName: \"kubernetes.io/projected/40eabb08-c880-4b5f-9624-c3843ab8a753-kube-api-access-x7qg2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb\" (UID: \"40eabb08-c880-4b5f-9624-c3843ab8a753\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:46.085789 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:46.085713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:47:46.218525 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:46.218495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb"] Jun 14 21:47:46.221078 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:47:46.221049 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40eabb08_c880_4b5f_9624_c3843ab8a753.slice/crio-a298062ff92abfc6c202e820d9ba6b03ebc4e793cdef6ed108b31862f8abb777 WatchSource:0}: Error finding container a298062ff92abfc6c202e820d9ba6b03ebc4e793cdef6ed108b31862f8abb777: Status 404 returned error can't find the container with id a298062ff92abfc6c202e820d9ba6b03ebc4e793cdef6ed108b31862f8abb777 Jun 14 21:47:46.736028 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:46.735989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" event={"ID":"40eabb08-c880-4b5f-9624-c3843ab8a753","Type":"ContainerStarted","Data":"cd8cfd5e2e82d64083000cf5dfa202017c80cedcad43b1d8df522e5d0a83c5fa"} Jun 14 21:47:46.736254 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:47:46.736050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" event={"ID":"40eabb08-c880-4b5f-9624-c3843ab8a753","Type":"ContainerStarted","Data":"a298062ff92abfc6c202e820d9ba6b03ebc4e793cdef6ed108b31862f8abb777"} Jun 14 21:48:05.304259 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:05.304215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:05.404998 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:05.404960 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:08.203249 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:08.203209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:11.880698 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:11.880661 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:11.938235 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:11.938199 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:12.888317 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:12.888284 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:20.791054 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:20.791016 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:20.840876 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:20.840835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:29.396391 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:29.396356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:30.353883 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:30.353847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:48:33.959762 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:33.959730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:48:33.962145 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:33.960913 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:48:36.985718 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:36.985683 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a157606-dd41-4a53-ab1a-724de21d55ae" containerID="56c13db44823b5aad1680f17e81723b559516b829ba7e5d323ac9644b27b2b28" exitCode=0 Jun 14 21:48:36.986126 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:36.985757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" event={"ID":"8a157606-dd41-4a53-ab1a-724de21d55ae","Type":"ContainerDied","Data":"56c13db44823b5aad1680f17e81723b559516b829ba7e5d323ac9644b27b2b28"} Jun 14 21:48:38.996996 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:38.996957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" event={"ID":"8a157606-dd41-4a53-ab1a-724de21d55ae","Type":"ContainerStarted","Data":"c9ee01bf9ed70b5c7d067ca252c84f1c5ce2256e343da0f73a098e88e4702a29"} Jun 14 21:48:39.014601 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:39.014530 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" podStartSLOduration=2.744516267 podStartE2EDuration="58.01451303s" totalImagesPullingTime="982.448728ms" totalInitContainerRuntime="54.287548035s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:48:39.013210803 +0000 UTC m=+907.363830675" watchObservedRunningTime="2026-06-14 21:48:39.01451303 +0000 UTC m=+907.365132905" Jun 14 21:48:41.966721 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:41.966677 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:48:41.967142 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:41.966756 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:48:41.979359 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:41.979337 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:48:42.022766 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:48:42.022742 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z" Jun 14 21:49:29.233866 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:29.233784 2562 generic.go:356] "Generic (PLEG): container finished" podID="d4231420-c7a3-4622-80f5-9cc05882155c" containerID="d1aa1c665bbcfef6ea0dcd14fd93da14cddaee218b84511e743f741cf7c6694a" exitCode=0 Jun 14 21:49:29.233866 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:29.233825 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" event={"ID":"d4231420-c7a3-4622-80f5-9cc05882155c","Type":"ContainerDied","Data":"d1aa1c665bbcfef6ea0dcd14fd93da14cddaee218b84511e743f741cf7c6694a"} Jun 14 21:49:30.240086 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:30.240051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" event={"ID":"d4231420-c7a3-4622-80f5-9cc05882155c","Type":"ContainerStarted","Data":"0d19bc25281bc6bbb0a0c6054663bb811c0a15d0042dde50ca824ea96d3a33e5"} Jun 14 21:49:30.260193 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:30.260143 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" podStartSLOduration=1.956715064 podStartE2EDuration="2m5.26012964s" totalImagesPullingTime="3.120668995s" totalInitContainerRuntime="2m0.182745581s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:47:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:49:30.257427374 +0000 UTC m=+958.608047246" watchObservedRunningTime="2026-06-14 21:49:30.26012964 +0000 UTC m=+958.610749512" Jun 14 21:49:33.259114 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:33.259078 2562 generic.go:356] "Generic (PLEG): container finished" podID="40eabb08-c880-4b5f-9624-c3843ab8a753" containerID="cd8cfd5e2e82d64083000cf5dfa202017c80cedcad43b1d8df522e5d0a83c5fa" exitCode=0 Jun 14 21:49:33.259470 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:33.259151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" event={"ID":"40eabb08-c880-4b5f-9624-c3843ab8a753","Type":"ContainerDied","Data":"cd8cfd5e2e82d64083000cf5dfa202017c80cedcad43b1d8df522e5d0a83c5fa"} Jun 14 21:49:34.272596 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:34.272530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" event={"ID":"40eabb08-c880-4b5f-9624-c3843ab8a753","Type":"ContainerStarted","Data":"8ca114b6c852d867d7cc9b070280808ef4f1e3b30ac52ba8f25d3aa90b857df6"} Jun 14 21:49:34.293075 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:34.293021 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" podStartSLOduration=2.99361324 podStartE2EDuration="1m49.293005s" totalImagesPullingTime="186.100282ms" totalInitContainerRuntime="1m46.113291478s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:49:34.290438825 +0000 UTC m=+962.641058696" watchObservedRunningTime="2026-06-14 21:49:34.293005 +0000 UTC m=+962.643624870" Jun 14 21:49:35.497081 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:35.497047 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:49:35.497544 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:35.497118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:49:35.509338 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:35.509306 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:49:36.086647 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:36.086619 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:49:36.086845 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:36.086749 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:49:36.099089 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:36.099067 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:49:36.292507 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:36.292478 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm" Jun 14 21:49:36.293343 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:49:36.293326 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb" Jun 14 21:53:33.991754 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:33.991654 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:53:33.995873 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:33.994390 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhvtv_8aeb0415-7757-4cb7-8c29-f641f9a46ead/ovn-acl-logging/0.log" Jun 14 21:53:47.290130 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:47.290097 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-79d5d876dc-cpjhr_91e7fd56-a6d9-445f-8e7c-9703de475131/maas-api/0.log" Jun 14 21:53:47.414991 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:47.414958 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c865b7554-46g2d_47ee859f-3b66-4493-8b68-b32742ff7dcd/manager/0.log" Jun 14 21:53:47.988725 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:47.988696 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-xqnw4_06d30a58-2d90-4316-98ed-8248ca987b1c/copy-manifests/0.log" Jun 14 21:53:48.007150 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:48.007112 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-xqnw4_06d30a58-2d90-4316-98ed-8248ca987b1c/manager/0.log" Jun 14 21:53:49.723967 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:49.723933 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6fm7f_866d14fb-3176-40e7-96c3-a2b86118e929/kuadrant-console-plugin/0.log" Jun 14 21:53:49.957829 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:49.957800 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7vj4c_62271650-fa1c-472e-973b-1dcdbf29310e/manager/0.log" Jun 14 21:53:50.744095 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:50.744065 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-nq8zq_ec8ed7f9-a227-44ed-ac29-ede07d3e910e/kube-auth-proxy/0.log" Jun 14 21:53:51.081990 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:51.081960 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vbktm_3734494e-cf95-4c65-8d48-7fa25aab9668/payload-pre-processing/0.log" Jun 14 21:53:51.305309 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:51.305277 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86b4776d-qj94x_c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7/router/0.log" Jun 14 21:53:51.655751 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:51.655724 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm_d4231420-c7a3-4622-80f5-9cc05882155c/storage-initializer/0.log" Jun 14 21:53:51.663667 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:51.663641 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-j6khm_d4231420-c7a3-4622-80f5-9cc05882155c/main/0.log" Jun 14 21:53:51.888173 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:51.888115 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z_8a157606-dd41-4a53-ab1a-724de21d55ae/storage-initializer/0.log" Jun 14 21:53:51.895686 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:51.895659 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-tr56z_8a157606-dd41-4a53-ab1a-724de21d55ae/main/0.log" Jun 14 21:53:52.006396 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:52.006293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb_40eabb08-c880-4b5f-9624-c3843ab8a753/storage-initializer/0.log" Jun 14 21:53:52.014821 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:52.014785 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czbsnb_40eabb08-c880-4b5f-9624-c3843ab8a753/main/0.log" Jun 14 21:53:56.723248 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:56.723207 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:53:57.960683 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:57.960642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" limit=1024 Jun 14 21:53:59.507028 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:59.506991 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s9fvf_b2267a16-a530-42bf-ae41-2f080b488a89/global-pull-secret-syncer/0.log" Jun 14 21:53:59.595846 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:59.595817 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hqcn6_02c515c5-0202-409c-9849-d94d4f44ef2a/konnectivity-agent/0.log" Jun 14 21:53:59.668651 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:53:59.668616 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-159.ec2.internal_8ed6de627129f31f4d7226feeb6c47d8/haproxy/0.log" Jun 14 21:54:04.455506 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:04.455475 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6fm7f_866d14fb-3176-40e7-96c3-a2b86118e929/kuadrant-console-plugin/0.log" Jun 14 21:54:04.528888 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:04.528842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7vj4c_62271650-fa1c-472e-973b-1dcdbf29310e/manager/0.log" Jun 14 21:54:06.167912 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.167883 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/alertmanager/0.log" Jun 14 21:54:06.195109 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.195079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/config-reloader/0.log" Jun 14 21:54:06.216612 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.216583 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/kube-rbac-proxy-web/0.log" Jun 14 21:54:06.236899 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.236870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/kube-rbac-proxy/0.log" Jun 14 21:54:06.258678 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.258651 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/kube-rbac-proxy-metric/0.log" Jun 14 21:54:06.285065 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.285045 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/prom-label-proxy/0.log" Jun 14 21:54:06.308655 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.308629 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_49f95ec2-35c1-48d9-8571-aaf574092eaf/init-config-reloader/0.log" Jun 14 21:54:06.351203 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.351135 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-n5tm8_5419fc9c-4dab-4b61-895d-4b402a659438/cluster-monitoring-operator/0.log" Jun 14 21:54:06.579964 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.579937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4qxv_d002fcf6-741f-4f2f-b1e1-94ebd57c2427/node-exporter/0.log" Jun 14 21:54:06.599787 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.599762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4qxv_d002fcf6-741f-4f2f-b1e1-94ebd57c2427/kube-rbac-proxy/0.log" Jun 14 21:54:06.619431 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.619360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4qxv_d002fcf6-741f-4f2f-b1e1-94ebd57c2427/init-textfile/0.log" Jun 14 21:54:06.794856 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.794825 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bc44b_3fc353a6-ada2-43eb-8978-cf83e914e60f/kube-rbac-proxy-main/0.log" Jun 14 21:54:06.818518 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.818487 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bc44b_3fc353a6-ada2-43eb-8978-cf83e914e60f/kube-rbac-proxy-self/0.log" Jun 14 21:54:06.843526 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.843496 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bc44b_3fc353a6-ada2-43eb-8978-cf83e914e60f/openshift-state-metrics/0.log" Jun 14 21:54:06.893195 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.893110 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/prometheus/0.log" Jun 14 21:54:06.916386 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.916346 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/config-reloader/0.log" Jun 14 21:54:06.941250 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.941200 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/thanos-sidecar/0.log" Jun 14 21:54:06.961485 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.961451 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/kube-rbac-proxy-web/0.log" Jun 14 21:54:06.982366 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:06.982331 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/kube-rbac-proxy/0.log" Jun 14 21:54:07.002331 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.002300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/kube-rbac-proxy-thanos/0.log" Jun 14 21:54:07.033402 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.033378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0a03118a-c26d-4f02-ab2c-7a1b20fd481f/init-config-reloader/0.log" Jun 14 21:54:07.256982 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.256941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/thanos-query/0.log" Jun 14 21:54:07.314109 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.314064 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy-web/0.log" Jun 14 21:54:07.366834 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.366809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy/0.log" Jun 14 21:54:07.386804 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.386777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/prom-label-proxy/0.log" Jun 14 21:54:07.408094 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.408047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy-rules/0.log" Jun 14 21:54:07.429099 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:07.429071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76bf566b8b-88hx8_ba3de88f-8617-4a2d-84ab-1b374d38584f/kube-rbac-proxy-metrics/0.log" Jun 14 21:54:08.826293 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:08.826260 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-zhwlj_95afa596-dedc-439e-9805-2dc4fae1bfed/networking-console-plugin/0.log" Jun 14 21:54:10.119356 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.119318 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw"] Jun 14 21:54:10.123136 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.123112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.125202 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.125182 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmwh7\"/\"openshift-service-ca.crt\"" Jun 14 21:54:10.126031 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.126007 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tmwh7\"/\"default-dockercfg-rmv5q\"" Jun 14 21:54:10.126152 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.126064 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmwh7\"/\"kube-root-ca.crt\"" Jun 14 21:54:10.137266 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.131800 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw"] Jun 14 21:54:10.230449 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.230415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-proc\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.230657 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.230467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-sys\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.230657 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.230499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-lib-modules\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.230657 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.230523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79gmt\" (UniqueName: \"kubernetes.io/projected/005b5baa-8b2e-4e23-954b-5ab9fda193e2-kube-api-access-79gmt\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.230803 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.230723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-podres\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331517 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-proc\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331517 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-sys\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-lib-modules\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79gmt\" (UniqueName: \"kubernetes.io/projected/005b5baa-8b2e-4e23-954b-5ab9fda193e2-kube-api-access-79gmt\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-proc\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-sys\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-podres\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.331796 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-lib-modules\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.332057 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.331858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/005b5baa-8b2e-4e23-954b-5ab9fda193e2-podres\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.339304 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.339272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79gmt\" (UniqueName: \"kubernetes.io/projected/005b5baa-8b2e-4e23-954b-5ab9fda193e2-kube-api-access-79gmt\") pod \"perf-node-gather-daemonset-dmmzw\" (UID: \"005b5baa-8b2e-4e23-954b-5ab9fda193e2\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.442193 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.442101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:10.575865 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.575835 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw"] Jun 14 21:54:10.578815 ip-10-0-128-159 kubenswrapper[2562]: W0614 21:54:10.578787 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod005b5baa_8b2e_4e23_954b_5ab9fda193e2.slice/crio-61e99bcc71f28a3a2e416b8649b0a18ab3eda32b7444a421644522ecd27e450c WatchSource:0}: Error finding container 61e99bcc71f28a3a2e416b8649b0a18ab3eda32b7444a421644522ecd27e450c: Status 404 returned error can't find the container with id 61e99bcc71f28a3a2e416b8649b0a18ab3eda32b7444a421644522ecd27e450c Jun 14 21:54:10.617999 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:10.617968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" event={"ID":"005b5baa-8b2e-4e23-954b-5ab9fda193e2","Type":"ContainerStarted","Data":"61e99bcc71f28a3a2e416b8649b0a18ab3eda32b7444a421644522ecd27e450c"} Jun 14 21:54:11.624301 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:11.624262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" event={"ID":"005b5baa-8b2e-4e23-954b-5ab9fda193e2","Type":"ContainerStarted","Data":"24cd4027fe5b483ff3d990eed1e26c1fe766d112ac88d44592af08116c947891"} Jun 14 21:54:11.624750 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:11.624395 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:11.638707 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:11.638661 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" podStartSLOduration=1.63864785 podStartE2EDuration="1.63864785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:54:11.637687556 +0000 UTC m=+1239.988307427" watchObservedRunningTime="2026-06-14 21:54:11.63864785 +0000 UTC m=+1239.989267721" Jun 14 21:54:12.006171 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:12.006079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fnc7x_598ed8ce-96cb-40c9-ad90-a0293cc67363/dns/0.log" Jun 14 21:54:12.026689 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:12.026658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fnc7x_598ed8ce-96cb-40c9-ad90-a0293cc67363/kube-rbac-proxy/0.log" Jun 14 21:54:12.095115 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:12.095086 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8zpj_996f5f9e-8ec3-4f0f-95a5-84b68d052d83/dns-node-resolver/0.log" Jun 14 21:54:12.701373 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:12.701332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d5z8n_2b3d6888-b153-4809-b707-ec7b852a8341/node-ca/0.log" Jun 14 21:54:13.752112 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:13.752082 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-nq8zq_ec8ed7f9-a227-44ed-ac29-ede07d3e910e/kube-auth-proxy/0.log" Jun 14 21:54:13.821203 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:13.821174 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vbktm_3734494e-cf95-4c65-8d48-7fa25aab9668/payload-pre-processing/0.log" Jun 14 21:54:13.869671 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:13.869643 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86b4776d-qj94x_c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7/router/0.log" Jun 14 21:54:14.455949 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:14.455914 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-prbbn_3248c498-13d0-4d68-b422-7d189af93401/serve-healthcheck-canary/0.log" Jun 14 21:54:15.070700 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:15.070619 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jwpnx_3955e897-d4a6-42d9-b970-8795b502ce6f/kube-rbac-proxy/0.log" Jun 14 21:54:15.091905 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:15.091876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jwpnx_3955e897-d4a6-42d9-b970-8795b502ce6f/exporter/0.log" Jun 14 21:54:15.115004 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:15.114978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jwpnx_3955e897-d4a6-42d9-b970-8795b502ce6f/extractor/0.log" Jun 14 21:54:17.482087 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:17.482058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-79d5d876dc-cpjhr_91e7fd56-a6d9-445f-8e7c-9703de475131/maas-api/0.log" Jun 14 21:54:17.511752 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:17.511718 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c865b7554-46g2d_47ee859f-3b66-4493-8b68-b32742ff7dcd/manager/0.log" Jun 14 21:54:17.639332 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:17.639304 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-dmmzw" Jun 14 21:54:17.753386 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:17.753307 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-xqnw4_06d30a58-2d90-4316-98ed-8248ca987b1c/manager/0.log" Jun 14 21:54:17.770292 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:17.770267 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-xqnw4_06d30a58-2d90-4316-98ed-8248ca987b1c/copy-manifests/0.log" Jun 14 21:54:19.429748 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:19.429676 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dc5b57b86-g57xp_4b079ed4-c2b9-4395-94c2-06e434dabfb4/manager/0.log" Jun 14 21:54:24.488680 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:24.488641 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-nq8zq_ec8ed7f9-a227-44ed-ac29-ede07d3e910e/kube-auth-proxy/0.log" Jun 14 21:54:24.531806 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:24.531776 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vbktm_3734494e-cf95-4c65-8d48-7fa25aab9668/payload-pre-processing/0.log" Jun 14 21:54:24.567126 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:24.567087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86b4776d-qj94x_c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7/router/0.log" Jun 14 21:54:24.811056 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:24.811027 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-2drt7_d9edfbfa-c100-4890-8c54-cf51647bffb8/migrator/0.log" Jun 14 21:54:24.829705 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:24.829674 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-2drt7_d9edfbfa-c100-4890-8c54-cf51647bffb8/graceful-termination/0.log" Jun 14 21:54:25.299090 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:25.299059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7bkfv_d7fecedc-aee2-425e-b06e-0c4aa490e673/kube-storage-version-migrator-operator/1.log" Jun 14 21:54:25.300803 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:25.300768 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7bkfv_d7fecedc-aee2-425e-b06e-0c4aa490e673/kube-storage-version-migrator-operator/0.log" Jun 14 21:54:25.675618 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:25.675515 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-nq8zq_ec8ed7f9-a227-44ed-ac29-ede07d3e910e/kube-auth-proxy/0.log" Jun 14 21:54:25.726813 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:25.726779 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vbktm_3734494e-cf95-4c65-8d48-7fa25aab9668/payload-pre-processing/0.log" Jun 14 21:54:25.761261 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:25.761215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86b4776d-qj94x_c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7/router/0.log" Jun 14 21:54:26.601880 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:26.601852 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9jsc_2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5/kube-multus-additional-cni-plugins/0.log" Jun 14 21:54:26.623930 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:26.623891 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9jsc_2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5/egress-router-binary-copy/0.log" Jun 14 21:54:26.643710 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:26.643680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9jsc_2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5/cni-plugins/0.log" Jun 14 21:54:26.665151 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:26.665119 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9jsc_2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5/bond-cni-plugin/0.log" Jun 14 21:54:26.685861 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:26.685829 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9jsc_2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5/routeoverride-cni/0.log" Jun 14 21:54:26.705194 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:26.705168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9jsc_2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5/whereabouts-cni-bincopy/0.log" Jun 14 21:54:26.727388 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:26.727360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9jsc_2ddf2357-17ba-4b4d-b707-e1f6e8b43ba5/whereabouts-cni/0.log" Jun 14 21:54:27.069829 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:27.069803 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g4rtr_957388b6-85fb-4539-ab38-a1c584af238a/kube-multus/0.log" Jun 14 21:54:27.213716 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:27.213688 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qj4f9_35a7518d-ac6d-4a64-96dd-bdeaff580470/network-metrics-daemon/0.log" Jun 14 21:54:27.231530 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:27.231500 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qj4f9_35a7518d-ac6d-4a64-96dd-bdeaff580470/kube-rbac-proxy/0.log" Jun 14 21:54:27.423919 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:27.423830 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-nq8zq_ec8ed7f9-a227-44ed-ac29-ede07d3e910e/kube-auth-proxy/0.log" Jun 14 21:54:27.470942 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:27.470904 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vbktm_3734494e-cf95-4c65-8d48-7fa25aab9668/payload-pre-processing/0.log" Jun 14 21:54:27.505769 ip-10-0-128-159 kubenswrapper[2562]: I0614 21:54:27.505740 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86b4776d-qj94x_c4b8d7dc-6c01-4d51-966a-c1fdf0c360b7/router/0.log"