Jul 09 09:32:45.133330 ip-10-0-143-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.584639    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589817    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589830    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589834    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589837    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589840    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589844    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589847    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:32:45.597451 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589850    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589853    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589856    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589859    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589862    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589865    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589868    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589872    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589874    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589877    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589880    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589883    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589885    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589888    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589893    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589895    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589898    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589901    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589903    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589906    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:32:45.612452 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589909    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589911    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589914    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589916    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589919    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589924    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589927    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589930    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589933    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589936    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589939    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589942    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589945    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589947    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589950    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589953    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589956    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589959    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589962    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589965    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:32:45.662566 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589967    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589970    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589972    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589974    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589977    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589979    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589982    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589985    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589987    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589990    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589992    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589995    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.589997    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590000    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590002    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590004    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590007    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590011    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590015    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:32:45.707690 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590018    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:32:45.665877 ip-10-0-143-234 systemd[1]: Started Kubernetes Kubelet.
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590021    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590024    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590026    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590029    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590032    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590035    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590038    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590041    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590043    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590045    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590048    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590050    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590053    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590055    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590058    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590060    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590063    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590068    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:32:45.956102 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590071    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590074    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590089    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590093    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590096    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590098    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590101    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590103    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590106    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590108    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590112    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590115    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590118    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.590120    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591710    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591718    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591721    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591725    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591728    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:32:45.965593 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591731    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591734    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591737    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591739    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591742    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591744    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591747    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591750    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591752    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591754    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591757    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591760    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591762    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591765    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591768    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591771    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591774    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591777    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591779    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591782    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:32:45.966427 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591785    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591788    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591790    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591792    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591795    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591800    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591804    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591807    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591812    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591816    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591819    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591822    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591825    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591827    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591830    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591832    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591835    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591838    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591840    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:32:45.967172 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591843    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591846    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591849    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591851    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591854    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591857    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591859    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591862    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591865    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591868    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591871    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591873    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591876    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591878    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591881    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591883    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591886    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591888    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591891    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591893    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:32:45.967930 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591895    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591898    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591901    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591903    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591906    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591908    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591912    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591915    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591918    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591920    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591923    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591925    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591928    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591931    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591933    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591936    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591938    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591941    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591943    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591946    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:32:45.968763 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591948    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591951    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591954    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591957    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591960    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591962    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591965    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591968    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591970    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591973    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591975    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591978    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591980    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591983    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.591985    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592379    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592384    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592387    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592390    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:32:45.969363 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592393    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592395    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592400    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592403    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592406    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592408    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592411    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592414    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592416    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592419    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592422    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592424    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592427    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592429    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592432    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592435    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592438    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592441    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592444    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592446    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:32:45.969961 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592448    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592451    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592454    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592456    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592459    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592462    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592464    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592467    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592469    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592472    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592474    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592477    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592479    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592482    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592486    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592489    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592491    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592494    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592496    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592499    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:32:45.970557 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592502    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592504    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592507    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592510    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592514    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592518    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592522    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592525    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592528    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592531    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592535    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592538    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592540    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592543    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592546    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592548    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592551    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592554    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592556    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:32:45.971194 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592559    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592561    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592564    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592567    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592569    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592571    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592574    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592579    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592581    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592584    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592587    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592589    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592592    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592595    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592598    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592601    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592604    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592606    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592610    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:32:45.971788 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592614    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592618    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592621    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592624    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592627    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592630    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592632    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592635    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592637    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592640    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592643    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592645    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592648    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592650    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592653    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592655    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.592658    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592726    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592732    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592738    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592744    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 09:32:45.972382 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592748    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592751    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592755    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592759    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592762    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592765    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592769    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592773    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592776    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592779    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592783    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592786    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592789    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592792    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592796    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592799    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592802    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592806    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592809    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592813    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592816    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592819    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592822    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592825    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 09:32:45.972966 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592828    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592831    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592834    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592837    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592841    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592844    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592847    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592851    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592854    2563 flags.go:64] FLAG: --enable-server="true"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592857    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592861    2563 flags.go:64] FLAG: --event-burst="100"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592864    2563 flags.go:64] FLAG: --event-qps="50"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592867    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592870    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592873    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592880    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592883    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592886    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592890    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592893    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592895    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592898    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592901    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592904    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592907    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 09:32:45.973685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592910    2563 flags.go:64] FLAG: --feature-gates=""
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592914    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592917    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592919    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592923    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592925    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592928    2563 flags.go:64] FLAG: --help="false"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592931    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-143-234.ec2.internal"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592934    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592937    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592940    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592943    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592946    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592949    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592953    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592956    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592959    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592962    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592965    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592968    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592971    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592973    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592978    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592981    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 09:32:45.974420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592983    2563 flags.go:64] FLAG: --lock-file=""
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592986    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592989    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592992    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.592997    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593000    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593003    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593006    2563 flags.go:64] FLAG: --logging-format="text"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593009    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593012    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593015    2563 flags.go:64] FLAG: --manifest-url=""
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593018    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593022    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593025    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593029    2563 flags.go:64] FLAG: --max-pods="110"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593032    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593035    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593038    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593041    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593044    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593047    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593049    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593057    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593060    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593063    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 09:32:45.975108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593066    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593069    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593075    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593096    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593101    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593107    2563 flags.go:64] FLAG: --port="10250"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593111    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593114    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b49be74d40598019"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593117    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593120    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593123    2563 flags.go:64] FLAG: --register-node="true"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593126    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593130    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593133    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593135    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593138    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593142    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593146    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593149    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593152    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593154    2563 flags.go:64] FLAG: --runonce="false"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593158    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593160    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593163    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593166    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 09:32:45.975803 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593169    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593172    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593175    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593178    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593181    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593185    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593188    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593191    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593194    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593197    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593200    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593205    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593210    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593213    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593217    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593220    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593223    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593226    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593228    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593231    2563 flags.go:64] FLAG: --v="2"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593235    2563 flags.go:64] FLAG: --version="false"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593239    2563 flags.go:64] FLAG: --vmodule=""
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593242    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.593245    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 09:32:45.976525 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593363    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593367    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593370    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593373    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593376    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593379    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593382    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593384    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593387    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593389    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593391    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593394    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593396    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593401    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593403    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593406    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593408    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593411    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593413    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:32:45.977166 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593418    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593422    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593425    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593428    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593431    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593435    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593438    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593441    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593444    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593447    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593450    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593452    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593455    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593459    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593462    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593466    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593468    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593471    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593474    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:32:45.977724 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593476    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593479    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593481    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593484    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593486    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593489    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593491    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593496    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593498    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593501    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593503    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593506    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593508    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593511    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593514    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593517    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593519    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593522    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593525    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593527    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:32:45.978544 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593530    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593532    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593535    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593537    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593540    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593542    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593545    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593547    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593550    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593553    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593555    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593557    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593560    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593563    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593565    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593568    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593570    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593573    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593575    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593579    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:32:45.979156 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593581    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593584    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593586    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593589    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593592    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593594    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593598    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593601    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593603    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593606    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593609    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593611    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593614    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593617    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593619    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593622    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593624    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593626    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593629    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593632    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:32:46.226202 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.593634    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.594361    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.602711    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.602727    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.602748    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.602757    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602820    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602826    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602830    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602833    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602836    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602838    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602841    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602844    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602846    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:32:46.227503 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602849    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602852    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602855    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602858    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602862    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602865    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602870    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602873    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602877    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602880    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602883    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602886    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602888    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602892    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602895    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602898    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602901    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602903    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602906    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602909    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:32:46.227927 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602912    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602915    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602917    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602920    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602922    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602926    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602930    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602933    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602935    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602938    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602940    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602943    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602946    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602948    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602951    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602954    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602957    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602960    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602963    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602965    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:32:46.228539 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602968    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602970    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602973    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602975    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602978    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602981    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602983    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602986    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602989    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602991    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602994    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602996    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.602999    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603001    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603004    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603006    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603009    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603012    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603018    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603021    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:32:46.229066 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603024    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603027    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603029    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603032    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603034    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603037    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603039    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603042    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603044    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603051    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603055    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603057    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603061    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603064    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603067    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603070    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603073    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603093    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603097    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:32:46.229659 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603101    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603104    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603106    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603109    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603112    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603114    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603117    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603119    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603122    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603125    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603127    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.603132    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603248    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603254    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603257    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:32:46.230186 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603260    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603263    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603266    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603269    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603272    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603275    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603278    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603282    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603287    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603290    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603292    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603295    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603298    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603301    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603303    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603306    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603310    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603313    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603316    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:32:46.230634 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603319    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603322    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603325    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603328    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603330    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603333    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603336    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603339    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603341    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603344    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603346    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603349    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603351    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603354    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603356    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603359    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603361    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603364    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603366    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603369    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:32:46.231182 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603373    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603376    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603379    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603383    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603387    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603389    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603393    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603397    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603400    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603403    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603406    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603409    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603411    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603414    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603416    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603419    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603421    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603424    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603427    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603429    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:32:46.231732 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603432    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603435    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603437    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603439    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603442    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603444    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603447    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603449    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603452    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603454    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603456    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603459    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603463    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603467    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603470    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603472    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603475    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603478    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603481    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603483    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:32:46.232283 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603486    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603488    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603491    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603493    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603496    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603498    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603501    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603503    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603506    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603509    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603511    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603513    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603516    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603518    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603521    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603523    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:32:46.232846 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:45.603526    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.603531    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.603637    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.607687    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.609628    2563 server.go:1019] "Starting client certificate rotation"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.609724    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.609764    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.612867    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.614415    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.628232    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.631547    2563 log.go:25] "Validated CRI v1 image API"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.632330    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 09:32:46.233305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.634604    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 95b3d958-de53-48a4-a8c2-09f1a999199f:/dev/nvme0n1p4 d78b302f-2c2e-47bd-b324-b22787d14c0c:/dev/nvme0n1p3]
Jul 09 09:32:46.233695 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.634619    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 09:32:46.233766 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.640498    2563 manager.go:216] Machine: {Timestamp:2026-07-09 09:32:45.639923173 +0000 UTC m=+0.373798847 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102538 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f1450abea4d0e66f6224a27c46664 SystemUUID:ec2f1450-abea-4d0e-66f6-224a27c46664 BootID:ca0a6e5c-a7d0-44eb-a86d-9d5aa56c3fa0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:f5:08:97:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:f5:08:97:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:ef:fc:f8:23:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 09:32:46.233766 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.640585    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 09:32:46.233766 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.640660    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 09:32:46.233766 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.643551    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 09:32:46.233766 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.644190    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 09:32:46.233766 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.643581    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 09:32:46.233766 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.645379    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.645392    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.645400    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.645414    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.647046    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.650306    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.650541    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.651808    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.651826    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.651841    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.651853    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.651866    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.652253    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.652269    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.656364    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.658588    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.658618    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660524    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660540    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660549    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660557    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660570    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660578    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660589    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660601    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660610    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660617    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660629    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.660637    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.661549    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.661558    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.662486    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.662486    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.665177    2563 server.go:1268] "Started kubelet"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.665270    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.665313    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.666139    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.667189    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.667805    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 09:32:46.234047 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.671227    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.671843    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.671760    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-234.ec2.internal.18c0954296909193  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-234.ec2.internal,UID:ip-10-0-143-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-234.ec2.internal,},FirstTimestamp:2026-07-09 09:32:45.665153427 +0000 UTC m=+0.399029101,LastTimestamp:2026-07-09 09:32:45.665153427 +0000 UTC m=+0.399029101,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-234.ec2.internal,}"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.675521    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.675652    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.675673    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.676341    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.676352    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.676526    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.676601    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.676608    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.677604    2563 factory.go:55] Registering systemd factory
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.677630    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.677874    2563 factory.go:153] Registering CRI-O factory
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.677883    2563 factory.go:223] Registration of the crio container factory successfully
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.677922    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.677940    2563 factory.go:103] Registering Raw factory
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.677954    2563 manager.go:1196] Started watching for new ooms in manager
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.678330    2563 manager.go:349] Starting recovery of all containers
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.682903    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.683037    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.689969    2563 manager.go:354] Recovery completed
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.691493    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6bwvh"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.694327    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.696062    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.696107    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.696119    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.696605    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.696617    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.696634    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.696636    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.697299    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:32:46.235066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.697322    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.697332    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.697697    2563 policy_none.go:49] "None policy: Start"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.697709    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.697719    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.698049    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-234.ec2.internal.18c095429868a3bb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-234.ec2.internal,UID:ip-10-0-143-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-234.ec2.internal,},FirstTimestamp:2026-07-09 09:32:45.696091067 +0000 UTC m=+0.429966742,LastTimestamp:2026-07-09 09:32:45.696091067 +0000 UTC m=+0.429966742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-234.ec2.internal,}"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.698627    2563 policy_none.go:47] "Start"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.699431    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6bwvh"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.704969    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-234.ec2.internal.18c095429868fbaf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-234.ec2.internal,UID:ip-10-0-143-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-234.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-234.ec2.internal,},FirstTimestamp:2026-07-09 09:32:45.696113583 +0000 UTC m=+0.429989257,LastTimestamp:2026-07-09 09:32:45.696113583 +0000 UTC m=+0.429989257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-234.ec2.internal,}"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.748584    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.749736    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.749781    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.749807    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.749857    2563 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.752234    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.776641    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.797685    2563 manager.go:337] "Starting Device Plugin manager"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.797714    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.797724    2563 server.go:87] "Starting device plugin registration server"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.798008    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.798019    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.798128    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.798207    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.798215    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.798645    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.798700    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.235978 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.850825    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"]
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.850907    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.852562    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.852587    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.852597    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.853775    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.853880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.853919    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.854471    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.854496    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.854502    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.854508    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.854520    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.854529    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.855522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.855541    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.856199    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.856223    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.856235    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.870606    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-234.ec2.internal\" not found" node="ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.874948    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-234.ec2.internal\" not found" node="ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.888307    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-234.ec2.internal\" not found" node="ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.898105    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.899513    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.899539    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.899547    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.899569    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.907773    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.907790    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-234.ec2.internal\": node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:45.934564    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.236707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.977459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cdae5c352fef2f43ee2b9549e4108ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7cdae5c352fef2f43ee2b9549e4108ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.977633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cdae5c352fef2f43ee2b9549e4108ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7cdae5c352fef2f43ee2b9549e4108ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:45.977651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80846f74a51c761123ee116b63300c13-config\") pod \"kube-apiserver-proxy-ip-10-0-143-234.ec2.internal\" (UID: \"80846f74a51c761123ee116b63300c13\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.035562    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.077834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cdae5c352fef2f43ee2b9549e4108ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7cdae5c352fef2f43ee2b9549e4108ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.077883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cdae5c352fef2f43ee2b9549e4108ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7cdae5c352fef2f43ee2b9549e4108ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.077899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80846f74a51c761123ee116b63300c13-config\") pod \"kube-apiserver-proxy-ip-10-0-143-234.ec2.internal\" (UID: \"80846f74a51c761123ee116b63300c13\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.078103    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80846f74a51c761123ee116b63300c13-config\") pod \"kube-apiserver-proxy-ip-10-0-143-234.ec2.internal\" (UID: \"80846f74a51c761123ee116b63300c13\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.077934    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cdae5c352fef2f43ee2b9549e4108ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7cdae5c352fef2f43ee2b9549e4108ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.078273    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cdae5c352fef2f43ee2b9549e4108ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7cdae5c352fef2f43ee2b9549e4108ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.136097    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.173402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.178606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.237567 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.236545    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.466151 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.337017    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.466151 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.437379    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.537772    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.538319    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.577968    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.592252    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.594577    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.603062    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.608112    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.608237    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.608282    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.652315    2563 apiserver.go:52] "Watching apiserver"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.669143    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.669454    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-9479k","kube-system/global-pull-secret-syncer-c8gdf","kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz","openshift-dns/node-resolver-mw588","openshift-image-registry/node-ca-8h2j8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-k4w7s","openshift-multus/multus-h25c6","kube-system/konnectivity-agent-tqxkv","openshift-cluster-node-tuning-operator/tuned-v5qng","openshift-multus/network-metrics-daemon-nwxc5","openshift-network-diagnostics/network-check-target-zj2qx","openshift-network-operator/iptables-alerter-sttbf"]
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.669876    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.670848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.673018    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.673247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.673962    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.674197    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.674235    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sqpp8\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.674687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.675238    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.675438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zb4dg\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.675499    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w75b5\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.675891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.676235    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.676380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 09:32:46.706010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.676481    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.676482    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.676741    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.677272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5tb6\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.677346    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.677640    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.677703    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.678267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.678479    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.678489    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.678808    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.678822    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xcrp4\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.678842    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.679094    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.679148    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.680273    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.680337    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.680273    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.680404    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.680621    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.680630    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c6ptw\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.681389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.681429    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.681485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.681693    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4jjnp\""
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-modprobe-d\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.707447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-systemd\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-host\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-sys-fs\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6p8x\" (UniqueName: \"kubernetes.io/projected/72f564cb-147f-45ff-8465-bcec3d3c416d-kube-api-access-c6p8x\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5949b15b-4177-41bb-af59-ae0ff053647b-konnectivity-ca\") pod \"konnectivity-agent-tqxkv\" (UID: \"5949b15b-4177-41bb-af59-ae0ff053647b\") " pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-run\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gd8b\" (UniqueName: \"kubernetes.io/projected/c2edc93e-9538-4404-9150-bcad662577cb-kube-api-access-5gd8b\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb559\" (UniqueName: \"kubernetes.io/projected/748e2a5b-a615-4d1d-904a-83d370f3b8da-kube-api-access-vb559\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-host\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-kubernetes\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-lib-modules\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.682988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cnibin\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbhk\" (UniqueName: \"kubernetes.io/projected/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-kube-api-access-fsbhk\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rm7w\" (UniqueName: \"kubernetes.io/projected/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-kube-api-access-7rm7w\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/748e2a5b-a615-4d1d-904a-83d370f3b8da-host-slash\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-serviceca\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysconfig\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-registration-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5949b15b-4177-41bb-af59-ae0ff053647b-agent-certs\") pod \"konnectivity-agent-tqxkv\" (UID: \"5949b15b-4177-41bb-af59-ae0ff053647b\") " pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2edc93e-9538-4404-9150-bcad662577cb-tmp\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.708985 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-socket-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/748e2a5b-a615-4d1d-904a-83d370f3b8da-iptables-alerter-script\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-os-release\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysctl-d\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysctl-conf\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-sys\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-var-lib-kubelet\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2edc93e-9538-4404-9150-bcad662577cb-etc-tuned\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-device-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.683871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.683918    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.684786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.685069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.685216    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.686243    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.686261    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.686339    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 09:32:46.709409 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.686407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dsj7c\""
Jul 09 09:32:46.710175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.686415    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 09:32:46.710175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.690983    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 09:32:46.710175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.691133    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2vvqv\""
Jul 09 09:32:46.710175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.691143    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 09:32:46.710175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.693455    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 09:32:46.710175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.704952    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 09:27:46 +0000 UTC" deadline="2028-01-25 23:36:22.20375287 +0000 UTC"
Jul 09 09:32:46.710175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.704997    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13574h3m35.498758474s"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.712152    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dsf6t"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.722434    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dsf6t"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.778812    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysctl-conf\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-k8s-cni-cncf-io\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-env-overrides\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-modprobe-d\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-systemd\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783827    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysctl-conf\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-system-cni-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783877    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-modprobe-d\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-os-release\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783907    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-systemd\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.783992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5949b15b-4177-41bb-af59-ae0ff053647b-konnectivity-ca\") pod \"konnectivity-agent-tqxkv\" (UID: \"5949b15b-4177-41bb-af59-ae0ff053647b\") " pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:46.913725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gd8b\" (UniqueName: \"kubernetes.io/projected/c2edc93e-9538-4404-9150-bcad662577cb-kube-api-access-5gd8b\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb559\" (UniqueName: \"kubernetes.io/projected/748e2a5b-a615-4d1d-904a-83d370f3b8da-kube-api-access-vb559\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-host\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-etc-kubernetes\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-etc-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-kubernetes\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-lib-modules\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784158    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-host\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cnibin\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784300    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-kubernetes\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784367    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-lib-modules\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbhk\" (UniqueName: \"kubernetes.io/projected/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-kube-api-access-fsbhk\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784394    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cnibin\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.914832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-cni-netd\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-serviceca\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysconfig\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784598    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784617    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5949b15b-4177-41bb-af59-ae0ff053647b-konnectivity-ca\") pod \"konnectivity-agent-tqxkv\" (UID: \"5949b15b-4177-41bb-af59-ae0ff053647b\") " pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-registration-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-registration-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1ede5b3-978a-4e74-b910-b1fda01f7af1-dbus\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784692    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysconfig\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwhpb\" (UniqueName: \"kubernetes.io/projected/528db513-4644-4714-ae52-3bcdd7dc32cf-kube-api-access-bwhpb\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:46.915476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-log-socket\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovnkube-script-lib\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzng\" (UniqueName: \"kubernetes.io/projected/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-kube-api-access-nxzng\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5949b15b-4177-41bb-af59-ae0ff053647b-agent-certs\") pod \"konnectivity-agent-tqxkv\" (UID: \"5949b15b-4177-41bb-af59-ae0ff053647b\") " pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-socket-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-multus-certs\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-os-release\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-cni-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-netns\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovn-node-metrics-cert\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.784993    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-socket-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-sys\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785027    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-var-lib-kubelet\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.916120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-serviceca\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785091    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-os-release\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2edc93e-9538-4404-9150-bcad662577cb-etc-tuned\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-device-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-var-lib-kubelet\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-systemd-units\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785156    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785179    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-sys\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785182    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-run-ovn-kubernetes\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785215    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-device-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-host\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-sys-fs\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6p8x\" (UniqueName: \"kubernetes.io/projected/72f564cb-147f-45ff-8465-bcec3d3c416d-kube-api-access-c6p8x\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785287    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-host\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.916789 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-cni-binary-copy\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785318    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-sys-fs\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-cni-multus\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-ovn\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovnkube-config\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-run\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bac4a3-fae4-4839-8d41-617087c1f3a3-tmp-dir\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-cni-bin\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785536    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-daemon-config\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785555    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-run\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-run-netns\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.917560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-systemd\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785688    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rm7w\" (UniqueName: \"kubernetes.io/projected/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-kube-api-access-7rm7w\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785736    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72f564cb-147f-45ff-8465-bcec3d3c416d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-socket-dir-parent\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-kubelet\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.785984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-kubelet\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-var-lib-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/748e2a5b-a615-4d1d-904a-83d370f3b8da-host-slash\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786105    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/748e2a5b-a615-4d1d-904a-83d370f3b8da-host-slash\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g747\" (UniqueName: \"kubernetes.io/projected/68bac4a3-fae4-4839-8d41-617087c1f3a3-kube-api-access-9g747\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-slash\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-cni-bin\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.918134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvmql\" (UniqueName: \"kubernetes.io/projected/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-kube-api-access-fvmql\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2edc93e-9538-4404-9150-bcad662577cb-tmp\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1ede5b3-978a-4e74-b910-b1fda01f7af1-kubelet-config\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-cnibin\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-conf-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-node-log\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/748e2a5b-a615-4d1d-904a-83d370f3b8da-iptables-alerter-script\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68bac4a3-fae4-4839-8d41-617087c1f3a3-hosts-file\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-hostroot\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysctl-d\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.918756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786638    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2edc93e-9538-4404-9150-bcad662577cb-etc-sysctl-d\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.786905    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/748e2a5b-a615-4d1d-904a-83d370f3b8da-iptables-alerter-script\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.788729    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2edc93e-9538-4404-9150-bcad662577cb-etc-tuned\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.789493    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2edc93e-9538-4404-9150-bcad662577cb-tmp\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.793620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gd8b\" (UniqueName: \"kubernetes.io/projected/c2edc93e-9538-4404-9150-bcad662577cb-kube-api-access-5gd8b\") pod \"tuned-v5qng\" (UID: \"c2edc93e-9538-4404-9150-bcad662577cb\") " pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.793794    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb559\" (UniqueName: \"kubernetes.io/projected/748e2a5b-a615-4d1d-904a-83d370f3b8da-kube-api-access-vb559\") pod \"iptables-alerter-sttbf\" (UID: \"748e2a5b-a615-4d1d-904a-83d370f3b8da\") " pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.794022    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6p8x\" (UniqueName: \"kubernetes.io/projected/72f564cb-147f-45ff-8465-bcec3d3c416d-kube-api-access-c6p8x\") pod \"aws-ebs-csi-driver-node-x9mgz\" (UID: \"72f564cb-147f-45ff-8465-bcec3d3c416d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.794170    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbhk\" (UniqueName: \"kubernetes.io/projected/050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe-kube-api-access-fsbhk\") pod \"multus-additional-cni-plugins-k4w7s\" (UID: \"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.794762    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rm7w\" (UniqueName: \"kubernetes.io/projected/10bfbad4-7044-4a4a-aa40-b2d23abb80ae-kube-api-access-7rm7w\") pod \"node-ca-8h2j8\" (UID: \"10bfbad4-7044-4a4a-aa40-b2d23abb80ae\") " pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.795911    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5949b15b-4177-41bb-af59-ae0ff053647b-agent-certs\") pod \"konnectivity-agent-tqxkv\" (UID: \"5949b15b-4177-41bb-af59-ae0ff053647b\") " pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:46.872425    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80846f74a51c761123ee116b63300c13.slice/crio-e3c5d406cb6a693df2f356345c1d65c01960a4cd5bac3949b84ee7e8a99fdbe7 WatchSource:0}: Error finding container e3c5d406cb6a693df2f356345c1d65c01960a4cd5bac3949b84ee7e8a99fdbe7: Status 404 returned error can't find the container with id e3c5d406cb6a693df2f356345c1d65c01960a4cd5bac3949b84ee7e8a99fdbe7
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:46.874295    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdae5c352fef2f43ee2b9549e4108ef.slice/crio-41e5fcec7b64e4f542f883514b3aac792534dfe615a0346433e42e7d1f04fc64 WatchSource:0}: Error finding container 41e5fcec7b64e4f542f883514b3aac792534dfe615a0346433e42e7d1f04fc64: Status 404 returned error can't find the container with id 41e5fcec7b64e4f542f883514b3aac792534dfe615a0346433e42e7d1f04fc64
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.882494    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-cni-bin\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.919357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-daemon-config\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-run-netns\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-systemd\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-socket-dir-parent\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-kubelet\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-kubelet\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887441    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-systemd\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-var-lib-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-run-netns\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887490    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-cni-bin\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g747\" (UniqueName: \"kubernetes.io/projected/68bac4a3-fae4-4839-8d41-617087c1f3a3-kube-api-access-9g747\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887535    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-kubelet\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887536    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-kubelet\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887539    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-socket-dir-parent\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-slash\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.919821 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887568    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-var-lib-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887589    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-slash\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-cni-bin\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887624    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-cni-bin\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvmql\" (UniqueName: \"kubernetes.io/projected/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-kube-api-access-fvmql\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1ede5b3-978a-4e74-b910-b1fda01f7af1-kubelet-config\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-cnibin\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-conf-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-node-log\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887767    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-cnibin\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1ede5b3-978a-4e74-b910-b1fda01f7af1-kubelet-config\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887788    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-conf-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68bac4a3-fae4-4839-8d41-617087c1f3a3-hosts-file\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887804    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-node-log\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-hostroot\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887847    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-hostroot\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887848    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68bac4a3-fae4-4839-8d41-617087c1f3a3-hosts-file\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-k8s-cni-cncf-io\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-env-overrides\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-system-cni-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887945    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-k8s-cni-cncf-io\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887944    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887964    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-daemon-config\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-system-cni-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.887957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-os-release\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-os-release\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-etc-kubernetes\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:46.920965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-etc-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888808    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-etc-kubernetes\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-cni-netd\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888865    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-etc-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.888888    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888929    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-cni-netd\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.888944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1ede5b3-978a-4e74-b910-b1fda01f7af1-dbus\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.888962    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.889009    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:32:47.388958233 +0000 UTC m=+2.122833917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwhpb\" (UniqueName: \"kubernetes.io/projected/528db513-4644-4714-ae52-3bcdd7dc32cf-kube-api-access-bwhpb\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889031    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-openvswitch\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-log-socket\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889105    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1ede5b3-978a-4e74-b910-b1fda01f7af1-dbus\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:46.921581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889132    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-env-overrides\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.889153    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret podName:a1ede5b3-978a-4e74-b910-b1fda01f7af1 nodeName:}" failed. No retries permitted until 2026-07-09 09:32:47.389136519 +0000 UTC m=+2.123012186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret") pod "global-pull-secret-syncer-c8gdf" (UID: "a1ede5b3-978a-4e74-b910-b1fda01f7af1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889205    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-log-socket\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovnkube-script-lib\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzng\" (UniqueName: \"kubernetes.io/projected/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-kube-api-access-nxzng\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-multus-certs\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-cni-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-netns\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovn-node-metrics-cert\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-systemd-units\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-run-ovn-kubernetes\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-cni-binary-copy\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-cni-multus\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-ovn\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922085 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889718    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovnkube-script-lib\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovnkube-config\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bac4a3-fae4-4839-8d41-617087c1f3a3-tmp-dir\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-systemd-units\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-host-run-ovn-kubernetes\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889906    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-run-ovn\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.889958    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-var-lib-cni-multus\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.890239    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68bac4a3-fae4-4839-8d41-617087c1f3a3-tmp-dir\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.890488    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovnkube-config\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.890584    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-multus-cni-dir\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.890647    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-multus-certs\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.890702    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-host-run-netns\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.890753    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-cni-binary-copy\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.896662    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-ovn-node-metrics-cert\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.897251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g747\" (UniqueName: \"kubernetes.io/projected/68bac4a3-fae4-4839-8d41-617087c1f3a3-kube-api-access-9g747\") pod \"node-resolver-mw588\" (UID: \"68bac4a3-fae4-4839-8d41-617087c1f3a3\") " pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.897345    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:32:46.922602 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.897363    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:32:46.923110 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.897375    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9fwzn for pod openshift-network-diagnostics/network-check-target-zj2qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:46.923110 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:46.897433    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn podName:0faee550-be67-4425-b562-7c2b5ec4d14b nodeName:}" failed. No retries permitted until 2026-07-09 09:32:47.397420153 +0000 UTC m=+2.131295833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9fwzn" (UniqueName: "kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn") pod "network-check-target-zj2qx" (UID: "0faee550-be67-4425-b562-7c2b5ec4d14b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:46.923110 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.903816    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvmql\" (UniqueName: \"kubernetes.io/projected/7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e-kube-api-access-fvmql\") pod \"multus-h25c6\" (UID: \"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e\") " pod="openshift-multus/multus-h25c6"
Jul 09 09:32:46.923110 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.905480    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzng\" (UniqueName: \"kubernetes.io/projected/7c88aebb-be7d-4601-aeaa-fd649b8d1f02-kube-api-access-nxzng\") pod \"ovnkube-node-9479k\" (UID: \"7c88aebb-be7d-4601-aeaa-fd649b8d1f02\") " pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:46.923110 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.905565    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwhpb\" (UniqueName: \"kubernetes.io/projected/528db513-4644-4714-ae52-3bcdd7dc32cf-kube-api-access-bwhpb\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.992656    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:46.997606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.007612    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5949b15b_4177_41bb_af59_ae0ff053647b.slice/crio-981e4a219b2770dd10d4cf642e292b24420fabd9505d4aae8f1d8a88669ecbf2 WatchSource:0}: Error finding container 981e4a219b2770dd10d4cf642e292b24420fabd9505d4aae8f1d8a88669ecbf2: Status 404 returned error can't find the container with id 981e4a219b2770dd10d4cf642e292b24420fabd9505d4aae8f1d8a88669ecbf2
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.014984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5qng"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.023294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2edc93e_9538_4404_9150_bcad662577cb.slice/crio-558afa065f05d248695d949499b46a3156bacd062525859974a15f73b8917f0c WatchSource:0}: Error finding container 558afa065f05d248695d949499b46a3156bacd062525859974a15f73b8917f0c: Status 404 returned error can't find the container with id 558afa065f05d248695d949499b46a3156bacd062525859974a15f73b8917f0c
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.039232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sttbf"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.047760    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748e2a5b_a615_4d1d_904a_83d370f3b8da.slice/crio-16251b05acf2b9eaf87216cba720da4ecae21f6398b03592858bfd09072faf0d WatchSource:0}: Error finding container 16251b05acf2b9eaf87216cba720da4ecae21f6398b03592858bfd09072faf0d: Status 404 returned error can't find the container with id 16251b05acf2b9eaf87216cba720da4ecae21f6398b03592858bfd09072faf0d
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.049778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.058372    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f564cb_147f_45ff_8465_bcec3d3c416d.slice/crio-87a3884225394934b36da0eb75ccc3e01d3ffd5e6fc650f0689bab863ad4b2a2 WatchSource:0}: Error finding container 87a3884225394934b36da0eb75ccc3e01d3ffd5e6fc650f0689bab863ad4b2a2: Status 404 returned error can't find the container with id 87a3884225394934b36da0eb75ccc3e01d3ffd5e6fc650f0689bab863ad4b2a2
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.066578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k4w7s"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.074909    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050bb6ef_d0a0_48ad_ac0e_a05044f2f9fe.slice/crio-8ae1ea83670a961e7646255ee4b51093fa3c15f1f2696b9ff058f2657cce3417 WatchSource:0}: Error finding container 8ae1ea83670a961e7646255ee4b51093fa3c15f1f2696b9ff058f2657cce3417: Status 404 returned error can't find the container with id 8ae1ea83670a961e7646255ee4b51093fa3c15f1f2696b9ff058f2657cce3417
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.083395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8h2j8"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.092377    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bfbad4_7044_4a4a_aa40_b2d23abb80ae.slice/crio-19dcd51ab5c42f10926d0587a8d3c0a58aa0349d4952abb0f657821f2beb4a25 WatchSource:0}: Error finding container 19dcd51ab5c42f10926d0587a8d3c0a58aa0349d4952abb0f657821f2beb4a25: Status 404 returned error can't find the container with id 19dcd51ab5c42f10926d0587a8d3c0a58aa0349d4952abb0f657821f2beb4a25
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.108443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h25c6"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.126022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.131655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mw588"
Jul 09 09:32:47.171530 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.134906    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c88aebb_be7d_4601_aeaa_fd649b8d1f02.slice/crio-533c5c041eacd2de50b2e9a5ee3859cac8fce542c882102db6faad3efe983319 WatchSource:0}: Error finding container 533c5c041eacd2de50b2e9a5ee3859cac8fce542c882102db6faad3efe983319: Status 404 returned error can't find the container with id 533c5c041eacd2de50b2e9a5ee3859cac8fce542c882102db6faad3efe983319
Jul 09 09:32:47.174050 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:32:47.142331    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bac4a3_fae4_4839_8d41_617087c1f3a3.slice/crio-1ba053c1e5b06ece15aafc0a0ca33c4bc40ed6070adea97af275c285543cbf5b WatchSource:0}: Error finding container 1ba053c1e5b06ece15aafc0a0ca33c4bc40ed6070adea97af275c285543cbf5b: Status 404 returned error can't find the container with id 1ba053c1e5b06ece15aafc0a0ca33c4bc40ed6070adea97af275c285543cbf5b
Jul 09 09:32:47.447641 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.395231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:47.447641 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.395269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:47.447641 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.395393    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:47.447641 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.395423    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:47.447641 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.395462    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:32:48.395445513 +0000 UTC m=+3.129321190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:47.447641 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.395478    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret podName:a1ede5b3-978a-4e74-b910-b1fda01f7af1 nodeName:}" failed. No retries permitted until 2026-07-09 09:32:48.395471128 +0000 UTC m=+3.129346795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret") pod "global-pull-secret-syncer-c8gdf" (UID: "a1ede5b3-978a-4e74-b910-b1fda01f7af1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:47.607246 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.495543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:47.607246 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.495715    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:32:47.607246 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.495739    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:32:47.607246 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.495751    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9fwzn for pod openshift-network-diagnostics/network-check-target-zj2qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:47.607246 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:47.495803    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn podName:0faee550-be67-4425-b562-7c2b5ec4d14b nodeName:}" failed. No retries permitted until 2026-07-09 09:32:48.495788712 +0000 UTC m=+3.229664375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fwzn" (UniqueName: "kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn") pod "network-check-target-zj2qx" (UID: "0faee550-be67-4425-b562-7c2b5ec4d14b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:47.869638 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.867413    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 09:27:47 +0000 UTC" deadline="2028-02-02 19:53:10.76367858 +0000 UTC"
Jul 09 09:32:47.869638 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.867478    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13762h20m22.896204703s"
Jul 09 09:32:47.875950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.872586    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.884772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mw588" event={"ID":"68bac4a3-fae4-4839-8d41-617087c1f3a3","Type":"ContainerStarted","Data":"1ba053c1e5b06ece15aafc0a0ca33c4bc40ed6070adea97af275c285543cbf5b"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.887584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"533c5c041eacd2de50b2e9a5ee3859cac8fce542c882102db6faad3efe983319"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.893725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8h2j8" event={"ID":"10bfbad4-7044-4a4a-aa40-b2d23abb80ae","Type":"ContainerStarted","Data":"19dcd51ab5c42f10926d0587a8d3c0a58aa0349d4952abb0f657821f2beb4a25"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.911633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerStarted","Data":"8ae1ea83670a961e7646255ee4b51093fa3c15f1f2696b9ff058f2657cce3417"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.917731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz" event={"ID":"72f564cb-147f-45ff-8465-bcec3d3c416d","Type":"ContainerStarted","Data":"87a3884225394934b36da0eb75ccc3e01d3ffd5e6fc650f0689bab863ad4b2a2"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.927638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sttbf" event={"ID":"748e2a5b-a615-4d1d-904a-83d370f3b8da","Type":"ContainerStarted","Data":"16251b05acf2b9eaf87216cba720da4ecae21f6398b03592858bfd09072faf0d"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.930695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5qng" event={"ID":"c2edc93e-9538-4404-9150-bcad662577cb","Type":"ContainerStarted","Data":"558afa065f05d248695d949499b46a3156bacd062525859974a15f73b8917f0c"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.936048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqxkv" event={"ID":"5949b15b-4177-41bb-af59-ae0ff053647b","Type":"ContainerStarted","Data":"981e4a219b2770dd10d4cf642e292b24420fabd9505d4aae8f1d8a88669ecbf2"}
Jul 09 09:32:47.937947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.937312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h25c6" event={"ID":"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e","Type":"ContainerStarted","Data":"f4d8c99185dfb99d6f1c7fa0ea270573b9393a99dbe41fb073e4fca2c0f97802"}
Jul 09 09:32:47.939599 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.938708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" event={"ID":"7cdae5c352fef2f43ee2b9549e4108ef","Type":"ContainerStarted","Data":"41e5fcec7b64e4f542f883514b3aac792534dfe615a0346433e42e7d1f04fc64"}
Jul 09 09:32:47.955362 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:47.943450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal" event={"ID":"80846f74a51c761123ee116b63300c13","Type":"ContainerStarted","Data":"e3c5d406cb6a693df2f356345c1d65c01960a4cd5bac3949b84ee7e8a99fdbe7"}
Jul 09 09:32:48.472557 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.472470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:48.472557 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.472525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:48.472795 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.472712    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:48.472795 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.472777    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret podName:a1ede5b3-978a-4e74-b910-b1fda01f7af1 nodeName:}" failed. No retries permitted until 2026-07-09 09:32:50.472758741 +0000 UTC m=+5.206634417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret") pod "global-pull-secret-syncer-c8gdf" (UID: "a1ede5b3-978a-4e74-b910-b1fda01f7af1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:48.473303 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.473281    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:48.473416 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.473351    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:32:50.473325114 +0000 UTC m=+5.207200802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:48.574488 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.573746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:48.574488 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.573983    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:32:48.574488 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.574005    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:32:48.574488 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.574019    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9fwzn for pod openshift-network-diagnostics/network-check-target-zj2qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:48.574488 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.574081    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn podName:0faee550-be67-4425-b562-7c2b5ec4d14b nodeName:}" failed. No retries permitted until 2026-07-09 09:32:50.57406275 +0000 UTC m=+5.307938435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fwzn" (UniqueName: "kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn") pod "network-check-target-zj2qx" (UID: "0faee550-be67-4425-b562-7c2b5ec4d14b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:48.752450 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.752365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:48.752614 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.752505    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:32:48.753024 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.753004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:48.753149 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.753121    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:32:48.753270 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.753203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:48.753324 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:48.753277    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:32:48.868016 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.867937    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 09:27:47 +0000 UTC" deadline="2028-04-19 22:25:41.514028518 +0000 UTC"
Jul 09 09:32:48.868016 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:48.868003    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15612h52m52.646030379s"
Jul 09 09:32:49.694075 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:49.694026    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:32:50.489560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:50.489517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:50.489778 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:50.489581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:50.489852 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.489776    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:50.489904 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.489853    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret podName:a1ede5b3-978a-4e74-b910-b1fda01f7af1 nodeName:}" failed. No retries permitted until 2026-07-09 09:32:54.489833199 +0000 UTC m=+9.223708879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret") pod "global-pull-secret-syncer-c8gdf" (UID: "a1ede5b3-978a-4e74-b910-b1fda01f7af1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:50.490358 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.490336    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:50.490478 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.490396    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:32:54.490379064 +0000 UTC m=+9.224254742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:50.590738 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:50.590691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:50.590945 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.590927    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:32:50.591031 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.590951    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:32:50.591031 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.590965    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9fwzn for pod openshift-network-diagnostics/network-check-target-zj2qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:50.591031 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.591029    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn podName:0faee550-be67-4425-b562-7c2b5ec4d14b nodeName:}" failed. No retries permitted until 2026-07-09 09:32:54.591008529 +0000 UTC m=+9.324884208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fwzn" (UniqueName: "kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn") pod "network-check-target-zj2qx" (UID: "0faee550-be67-4425-b562-7c2b5ec4d14b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:50.751556 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:50.750990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:50.751556 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.751160    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:32:50.751556 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:50.751252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:50.751556 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.751341    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:32:50.751556 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:50.751396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:50.751556 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:50.751470    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:32:52.751364 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:52.750582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:52.751364 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:52.750728    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:32:52.751364 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:52.751121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:52.751364 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:52.751204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:52.751364 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:52.751315    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:32:52.752105 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:52.751528    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:32:54.525640 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:54.525543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:54.525640 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:54.525593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:54.526204 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.525712    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:54.526204 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.525788    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:33:02.525768159 +0000 UTC m=+17.259643841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:32:54.526204 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.525712    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:54.526204 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.525837    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret podName:a1ede5b3-978a-4e74-b910-b1fda01f7af1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:02.525826959 +0000 UTC m=+17.259702626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret") pod "global-pull-secret-syncer-c8gdf" (UID: "a1ede5b3-978a-4e74-b910-b1fda01f7af1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:32:54.626915 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:54.626797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:54.627092 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.626951    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:32:54.627092 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.626977    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:32:54.627092 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.626992    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9fwzn for pod openshift-network-diagnostics/network-check-target-zj2qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:54.627092 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.627062    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn podName:0faee550-be67-4425-b562-7c2b5ec4d14b nodeName:}" failed. No retries permitted until 2026-07-09 09:33:02.627041479 +0000 UTC m=+17.360917156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fwzn" (UniqueName: "kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn") pod "network-check-target-zj2qx" (UID: "0faee550-be67-4425-b562-7c2b5ec4d14b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:32:54.750351 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:54.750314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:54.750532 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.750451    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:32:54.750665 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:54.750608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:54.750665 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:54.750620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:54.750804 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.750716    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:32:54.750861 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:54.750801    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:32:56.750027 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:56.749981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:56.750569 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:56.750041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:56.750569 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:56.750179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:56.750569 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:56.750185    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:32:56.750569 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:56.750322    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:32:56.750569 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:56.750466    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:32:58.750776 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:58.750744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:32:58.751154 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:58.750745    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:32:58.751154 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:58.750856    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:32:58.751154 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:32:58.750744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:32:58.751154 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:58.750928    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:32:58.751154 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:32:58.750990    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:00.750854 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:00.750812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:00.750854 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:00.750842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:00.750854 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:00.750855    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:00.751435 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:00.750948    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:00.751435 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:00.751100    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:00.751435 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:00.751214    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:02.587199 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:02.587163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:02.587199 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:02.587203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:02.587699 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.587307    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:02.587699 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.587313    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:02.587699 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.587366    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret podName:a1ede5b3-978a-4e74-b910-b1fda01f7af1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:18.587350282 +0000 UTC m=+33.321225951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret") pod "global-pull-secret-syncer-c8gdf" (UID: "a1ede5b3-978a-4e74-b910-b1fda01f7af1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:02.587699 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.587396    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:33:18.587375773 +0000 UTC m=+33.321251477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:02.687563 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:02.687526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:02.687746 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.687669    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:33:02.687746 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.687699    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:33:02.687746 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.687709    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9fwzn for pod openshift-network-diagnostics/network-check-target-zj2qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:02.687875 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.687774    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn podName:0faee550-be67-4425-b562-7c2b5ec4d14b nodeName:}" failed. No retries permitted until 2026-07-09 09:33:18.687756019 +0000 UTC m=+33.421631680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fwzn" (UniqueName: "kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn") pod "network-check-target-zj2qx" (UID: "0faee550-be67-4425-b562-7c2b5ec4d14b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:02.750140 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:02.750101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:02.750140 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:02.750124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:02.750374 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:02.750114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:02.750374 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.750244    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:02.750450 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.750367    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:02.750450 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:02.750422    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:04.750199 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:04.750157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:04.750619 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:04.750157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:04.750619 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:04.750286    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:04.750619 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:04.750390    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:04.750619 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:04.750168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:04.750619 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:04.750504    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:06.750723 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:06.750684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:06.750723 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:06.750724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:06.751243 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:06.750694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:06.751243 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:06.750822    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:06.751243 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:06.750915    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:06.751243 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:06.750999    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:08.751063 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:08.750886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:08.751454 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:08.750924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:08.751454 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:08.750943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:08.751454 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:08.751166    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:08.751454 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:08.751247    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:08.751454 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:08.751332    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:09.003327 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.003289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal" event={"ID":"80846f74a51c761123ee116b63300c13","Type":"ContainerStarted","Data":"a6d7962358a4baf2c0823444addd65cec40b27dd0f10f2fdc2840c292d61ebb1"}
Jul 09 09:33:09.004924 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.004895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mw588" event={"ID":"68bac4a3-fae4-4839-8d41-617087c1f3a3","Type":"ContainerStarted","Data":"5a87ad149cd744ac49d45b7acf5323989fa0ff292fc7486b7a5f48fb5b416562"}
Jul 09 09:33:09.008127 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.008105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"773c69c7aed7fffe970b150d9dd141311196e3ba00401bfe981dba9797275c4a"}
Jul 09 09:33:09.008282 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.008178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"4fb79928e3c380f323843418d85cab6881611464a1923a8e4ed43e245dc767a6"}
Jul 09 09:33:09.008282 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.008227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"81b907e359494f4269f7b987a089903c100fd67a268d3aa480834c98d80eea51"}
Jul 09 09:33:09.008282 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.008273    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"bfcd16bd3464edf22773efcf97eccc662414cb6b9670b8599c9363056c46ce2a"}
Jul 09 09:33:09.008438 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.008316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"8751404702fedd735ff65cd576b4ef1ae46afc31d9dedd6b9e9cfaf87650c443"}
Jul 09 09:33:09.008438 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.008364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"031129ac9e702f0febaa1d5886865e8cf8dbb3f8bb81a37cf34b6ad84a3c0703"}
Jul 09 09:33:09.009580 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.009557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8h2j8" event={"ID":"10bfbad4-7044-4a4a-aa40-b2d23abb80ae","Type":"ContainerStarted","Data":"876102c4ef4320b2cd7022d7322985583d94ad15491a3331392fcd3764e6e3cf"}
Jul 09 09:33:09.011039 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.011020    2563 generic.go:356] "Generic (PLEG): container finished" podID="050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe" containerID="9d2efcf86bebd4db240fb58e0d23b233a8b1a94ba30459aa899c88dc679294b4" exitCode=0
Jul 09 09:33:09.011139 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.011097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerDied","Data":"9d2efcf86bebd4db240fb58e0d23b233a8b1a94ba30459aa899c88dc679294b4"}
Jul 09 09:33:09.012703 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.012681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz" event={"ID":"72f564cb-147f-45ff-8465-bcec3d3c416d","Type":"ContainerStarted","Data":"0d3ea4e7591e2d85d450cd0ff8923a42815a24785ed46bbc28ecae76c3ceb2ec"}
Jul 09 09:33:09.014396 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.014371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5qng" event={"ID":"c2edc93e-9538-4404-9150-bcad662577cb","Type":"ContainerStarted","Data":"e2938ad0784aa7647252e80201fa7f4f7396bc3633122f4d67850231622316dc"}
Jul 09 09:33:09.015753 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.015734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqxkv" event={"ID":"5949b15b-4177-41bb-af59-ae0ff053647b","Type":"ContainerStarted","Data":"879b31ec8327a2709d4fe4e8ce72b13f5c98c64d38e6ee7fda6de276ccf41bca"}
Jul 09 09:33:09.017267 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.017247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h25c6" event={"ID":"7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e","Type":"ContainerStarted","Data":"f1f1e0fd9110e17de052a066d4851768b42a6e05ddcd2a7c335cedfa2d688891"}
Jul 09 09:33:09.020847 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.020827    2563 generic.go:356] "Generic (PLEG): container finished" podID="7cdae5c352fef2f43ee2b9549e4108ef" containerID="72101bcf788446393a4dc2e88e3f6fcf4184d23f1cd6072080386cd5ded4f177" exitCode=0
Jul 09 09:33:09.020933 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.020858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" event={"ID":"7cdae5c352fef2f43ee2b9549e4108ef","Type":"ContainerDied","Data":"72101bcf788446393a4dc2e88e3f6fcf4184d23f1cd6072080386cd5ded4f177"}
Jul 09 09:33:09.036119 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.036050    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal" podStartSLOduration=22.036036872 podStartE2EDuration="22.036036872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:09.01996492 +0000 UTC m=+23.753840602" watchObservedRunningTime="2026-07-09 09:33:09.036036872 +0000 UTC m=+23.769912551"
Jul 09 09:33:09.057284 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.057215    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h25c6" podStartSLOduration=1.953517915 podStartE2EDuration="23.057203881s" totalImagesPullingTime="21.103685966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:09.035800996 +0000 UTC m=+23.769676679" watchObservedRunningTime="2026-07-09 09:33:09.057203881 +0000 UTC m=+23.791079563"
Jul 09 09:33:09.070513 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.070482    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8h2j8" podStartSLOduration=5.904494862 podStartE2EDuration="23.07046967s" totalImagesPullingTime="17.165974808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:09.070413703 +0000 UTC m=+23.804289385" watchObservedRunningTime="2026-07-09 09:33:09.07046967 +0000 UTC m=+23.804345370"
Jul 09 09:33:09.086087 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.086041    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mw588" podStartSLOduration=1.06888792 podStartE2EDuration="22.086029559s" totalImagesPullingTime="21.017141639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:09.085509086 +0000 UTC m=+23.819384770" watchObservedRunningTime="2026-07-09 09:33:09.086029559 +0000 UTC m=+23.819905241"
Jul 09 09:33:09.099682 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.099648    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tqxkv" podStartSLOduration=9.988076357 podStartE2EDuration="23.0996385s" totalImagesPullingTime="13.111562143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:09.099116356 +0000 UTC m=+23.832992041" watchObservedRunningTime="2026-07-09 09:33:09.0996385 +0000 UTC m=+23.833514183"
Jul 09 09:33:09.291627 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.291593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:33:09.292383 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.292361    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:33:09.308316 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:09.308247    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v5qng" podStartSLOduration=2.168064305 podStartE2EDuration="23.30823408s" totalImagesPullingTime="21.140169775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:09.120435533 +0000 UTC m=+23.854311215" watchObservedRunningTime="2026-07-09 09:33:09.30823408 +0000 UTC m=+24.042109782"
Jul 09 09:33:10.024673 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.024632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sttbf" event={"ID":"748e2a5b-a615-4d1d-904a-83d370f3b8da","Type":"ContainerStarted","Data":"6e42c540e782532a0ed87cb25ba5998299c0bf95f2c970cce3f675ebdbcb1a4c"}
Jul 09 09:33:10.025655 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.025139    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:33:10.025885 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.025867    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tqxkv"
Jul 09 09:33:10.041578 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.041529    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sttbf" podStartSLOduration=2.931937671 podStartE2EDuration="24.041515314s" totalImagesPullingTime="21.109577643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:10.040923693 +0000 UTC m=+24.774799377" watchObservedRunningTime="2026-07-09 09:33:10.041515314 +0000 UTC m=+24.775390996"
Jul 09 09:33:10.224682 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.224658    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 09:33:10.750256 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.750228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:10.750496 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.750226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:10.750496 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:10.750335    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:10.750496 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.750360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:10.750496 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:10.750428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:10.750631 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:10.750496    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:10.881755 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.881665    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T09:33:10.22467726Z","UUID":"2f0b22bc-756c-4edd-9f72-abec6fa64a15","Handler":null,"Name":"","Endpoint":""}
Jul 09 09:33:10.883053 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.883036    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 09:33:10.883155 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:10.883071    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 09:33:11.029046 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:11.029018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz" event={"ID":"72f564cb-147f-45ff-8465-bcec3d3c416d","Type":"ContainerStarted","Data":"38f3fc5b3e4f2938170b83cb9e417f2d126feed03426ce90f7c085646eabe10b"}
Jul 09 09:33:11.030756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:11.030725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" event={"ID":"7cdae5c352fef2f43ee2b9549e4108ef","Type":"ContainerStarted","Data":"ddff8725933ac532bb986f2e7f0995dfd78c32bd5852a92c037822dd66bd7905"}
Jul 09 09:33:11.048124 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:11.048063    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" podStartSLOduration=24.048048986 podStartE2EDuration="24.048048986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:11.047748421 +0000 UTC m=+25.781624107" watchObservedRunningTime="2026-07-09 09:33:11.048048986 +0000 UTC m=+25.781924668"
Jul 09 09:33:12.036232 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:12.036161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"b71fe2429d23b49f8b4307f70b67c62e66c5a8799050591ab6e465cf7a51b940"}
Jul 09 09:33:12.038146 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:12.038121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz" event={"ID":"72f564cb-147f-45ff-8465-bcec3d3c416d","Type":"ContainerStarted","Data":"26955ab8c8d331ae5d10083e07c3e73d7ea5bba40092de1dda6a190f296af8aa"}
Jul 09 09:33:12.057867 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:12.057831    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9mgz" podStartSLOduration=2.293885525 podStartE2EDuration="26.057818281s" totalImagesPullingTime="23.763932756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:12.057426774 +0000 UTC m=+26.791302456" watchObservedRunningTime="2026-07-09 09:33:12.057818281 +0000 UTC m=+26.791693963"
Jul 09 09:33:12.750373 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:12.750335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:12.750559 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:12.750377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:12.750559 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:12.750335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:12.750559 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:12.750472    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:12.750559 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:12.750532    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:12.750755 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:12.750608    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:14.046463 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:14.046425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" event={"ID":"7c88aebb-be7d-4601-aeaa-fd649b8d1f02","Type":"ContainerStarted","Data":"8dcfe2e47b7ad4194b23337d88e18daa62aaf5fbb54190b334b5e654be460074"}
Jul 09 09:33:14.047015 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:14.046726    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:33:14.062996 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:14.062973    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:33:14.075910 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:14.075863    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9479k" podStartSLOduration=6.987128485 podStartE2EDuration="28.075848136s" totalImagesPullingTime="21.088719651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:14.075637909 +0000 UTC m=+28.809513584" watchObservedRunningTime="2026-07-09 09:33:14.075848136 +0000 UTC m=+28.809723819"
Jul 09 09:33:14.750307 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:14.750276    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:14.750466 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:14.750385    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:14.750466 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:14.750396    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:14.750466 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:14.750418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:14.750630 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:14.750513    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:14.750676 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:14.750637    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:15.049006 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.048945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:33:15.049507 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.049033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:33:15.063153 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.063130    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:33:15.253942 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.253910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c8gdf"]
Jul 09 09:33:15.254112 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.254012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:15.254196 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:15.254124    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:15.258660 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.258633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nwxc5"]
Jul 09 09:33:15.258784 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.258721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:15.258839 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:15.258797    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:15.275411 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.275387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zj2qx"]
Jul 09 09:33:15.275522 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:15.275463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:15.275574 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:15.275540    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:16.052613 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:16.052578    2563 generic.go:356] "Generic (PLEG): container finished" podID="050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe" containerID="ed13fd6d51a73789bb726db6c73824266be9d9ce88890a8d5b723e86748f6478" exitCode=0
Jul 09 09:33:16.053103 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:16.052629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerDied","Data":"ed13fd6d51a73789bb726db6c73824266be9d9ce88890a8d5b723e86748f6478"}
Jul 09 09:33:16.750787 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:16.750748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:16.750787 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:16.750774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:16.750970 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:16.750872    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:16.750970 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:16.750900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:16.750970 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:16.750959    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:16.751072 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:16.751003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:18.059752 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.059499    2563 generic.go:356] "Generic (PLEG): container finished" podID="050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe" containerID="96404c1c313f719ce09734eaeb3a5aac2ef76a80c512a43d9d80c723b1e15bca" exitCode=0
Jul 09 09:33:18.060120 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.059575    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerDied","Data":"96404c1c313f719ce09734eaeb3a5aac2ef76a80c512a43d9d80c723b1e15bca"}
Jul 09 09:33:18.606430 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.606390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:18.606602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.606445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:18.606602 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.606549    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:18.606602 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.606601    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:33:50.606587882 +0000 UTC m=+65.340463547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:18.606703 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.606549    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:18.606703 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.606671    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret podName:a1ede5b3-978a-4e74-b910-b1fda01f7af1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:50.606659454 +0000 UTC m=+65.340535119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret") pod "global-pull-secret-syncer-c8gdf" (UID: "a1ede5b3-978a-4e74-b910-b1fda01f7af1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:18.707340 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.707303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:18.707498 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.707475    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:33:18.707498 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.707497    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:33:18.707623 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.707509    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9fwzn for pod openshift-network-diagnostics/network-check-target-zj2qx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:18.707623 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.707571    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn podName:0faee550-be67-4425-b562-7c2b5ec4d14b nodeName:}" failed. No retries permitted until 2026-07-09 09:33:50.707554279 +0000 UTC m=+65.441429954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fwzn" (UniqueName: "kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn") pod "network-check-target-zj2qx" (UID: "0faee550-be67-4425-b562-7c2b5ec4d14b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:18.750765 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.750729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:18.750936 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.750744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:18.750936 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.750869    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:18.751037 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.750929    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:18.751037 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:18.750746    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:18.751037 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:18.751018    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:19.064429 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:19.064379    2563 generic.go:356] "Generic (PLEG): container finished" podID="050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe" containerID="de255f31ed9538e13c3a67736567730937edfff4e8881b7ebdf99cc39736d2c8" exitCode=0
Jul 09 09:33:19.064790 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:19.064447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerDied","Data":"de255f31ed9538e13c3a67736567730937edfff4e8881b7ebdf99cc39736d2c8"}
Jul 09 09:33:20.750839 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:20.750803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:20.751188 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:20.750803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:20.751188 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:20.750913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c8gdf" podUID="a1ede5b3-978a-4e74-b910-b1fda01f7af1"
Jul 09 09:33:20.751188 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:20.750803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:20.751188 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:20.750987    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwxc5" podUID="528db513-4644-4714-ae52-3bcdd7dc32cf"
Jul 09 09:33:20.751188 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:20.751063    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj2qx" podUID="0faee550-be67-4425-b562-7c2b5ec4d14b"
Jul 09 09:33:21.024428 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.024351    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeReady"
Jul 09 09:33:21.024578 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.024530    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 09:33:21.058622 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.058593    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6694cb7cf-6zz5n"]
Jul 09 09:33:21.062175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.062154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.065203 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.065182    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 09:33:21.065330 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.065207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 09:33:21.065330 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.065262    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 09:33:21.065442 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.065362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-45tlw\""
Jul 09 09:33:21.071688 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.071671    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 09:33:21.075071 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.075049    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-86td2"]
Jul 09 09:33:21.078949 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.078924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6694cb7cf-6zz5n"]
Jul 09 09:33:21.079042 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.079006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.092785 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.092765    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 09:33:21.094954 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.094843    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pgrtd"]
Jul 09 09:33:21.095318 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.095298    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 09:33:21.095415 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.095337    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mlrpb\""
Jul 09 09:33:21.099439 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.099423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.101736 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.101713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-86td2"]
Jul 09 09:33:21.102580 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.102313    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 09:33:21.102580 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.102421    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ckfzz\""
Jul 09 09:33:21.102580 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.102532    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 09:33:21.106460 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.106440    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 09:33:21.117845 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.117823    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgrtd"]
Jul 09 09:33:21.129170 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-certificates\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.129262 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-trusted-ca\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.129262 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.129262 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-bound-sa-token\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.129376 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-image-registry-private-configuration\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.129376 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-installation-pull-secrets\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.129376 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d16c692-0095-4628-b98a-3754b4d84ee1-ca-trust-extracted\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.129491 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.129397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj2z5\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-kube-api-access-rj2z5\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.230631 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.230599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-certificates\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.230631 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.230636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-trusted-ca\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.230884 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.230664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.230884 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.230768    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 09:33:21.230884 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.230788    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6694cb7cf-6zz5n: secret "image-registry-tls" not found
Jul 09 09:33:21.230884 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.230809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-bound-sa-token\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.230884 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.230856    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls podName:7d16c692-0095-4628-b98a-3754b4d84ee1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:21.730834347 +0000 UTC m=+36.464710025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls") pod "image-registry-6694cb7cf-6zz5n" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1") : secret "image-registry-tls" not found
Jul 09 09:33:21.230884 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.230878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q446l\" (UniqueName: \"kubernetes.io/projected/61211961-5730-4d10-a011-bde3efb0be25-kube-api-access-q446l\") pod \"ingress-canary-pgrtd\" (UID: \"61211961-5730-4d10-a011-bde3efb0be25\") " pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.230913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-image-registry-private-configuration\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.230978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-installation-pull-secrets\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8jhp\" (UniqueName: \"kubernetes.io/projected/183388ee-280b-416c-ae5c-f22ebf11c0b0-kube-api-access-z8jhp\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61211961-5730-4d10-a011-bde3efb0be25-cert\") pod \"ingress-canary-pgrtd\" (UID: \"61211961-5730-4d10-a011-bde3efb0be25\") " pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d16c692-0095-4628-b98a-3754b4d84ee1-ca-trust-extracted\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/183388ee-280b-416c-ae5c-f22ebf11c0b0-config-volume\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/183388ee-280b-416c-ae5c-f22ebf11c0b0-tmp-dir\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.231300 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj2z5\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-kube-api-access-rj2z5\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.231637 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.231637 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231386    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-certificates\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.231637 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.231447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d16c692-0095-4628-b98a-3754b4d84ee1-ca-trust-extracted\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.232304 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.232279    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-trusted-ca\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.235706 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.235686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-installation-pull-secrets\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.235796 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.235686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-image-registry-private-configuration\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.240202 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.240178    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj2z5\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-kube-api-access-rj2z5\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.240309 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.240222    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-bound-sa-token\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.332469 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.332440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8jhp\" (UniqueName: \"kubernetes.io/projected/183388ee-280b-416c-ae5c-f22ebf11c0b0-kube-api-access-z8jhp\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.332712 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.332484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61211961-5730-4d10-a011-bde3efb0be25-cert\") pod \"ingress-canary-pgrtd\" (UID: \"61211961-5730-4d10-a011-bde3efb0be25\") " pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.332712 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.332531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/183388ee-280b-416c-ae5c-f22ebf11c0b0-config-volume\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.332712 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.332550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/183388ee-280b-416c-ae5c-f22ebf11c0b0-tmp-dir\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.332712 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.332619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.332712 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.332682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q446l\" (UniqueName: \"kubernetes.io/projected/61211961-5730-4d10-a011-bde3efb0be25-kube-api-access-q446l\") pod \"ingress-canary-pgrtd\" (UID: \"61211961-5730-4d10-a011-bde3efb0be25\") " pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.332911 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.332783    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 09:33:21.332911 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.332878    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls podName:183388ee-280b-416c-ae5c-f22ebf11c0b0 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:21.832850009 +0000 UTC m=+36.566725669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls") pod "dns-default-86td2" (UID: "183388ee-280b-416c-ae5c-f22ebf11c0b0") : secret "dns-default-metrics-tls" not found
Jul 09 09:33:21.333019 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.332944    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/183388ee-280b-416c-ae5c-f22ebf11c0b0-tmp-dir\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.333303 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.333276    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/183388ee-280b-416c-ae5c-f22ebf11c0b0-config-volume\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.335404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.335380    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61211961-5730-4d10-a011-bde3efb0be25-cert\") pod \"ingress-canary-pgrtd\" (UID: \"61211961-5730-4d10-a011-bde3efb0be25\") " pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.342528 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.342503    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8jhp\" (UniqueName: \"kubernetes.io/projected/183388ee-280b-416c-ae5c-f22ebf11c0b0-kube-api-access-z8jhp\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.342761 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.342737    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q446l\" (UniqueName: \"kubernetes.io/projected/61211961-5730-4d10-a011-bde3efb0be25-kube-api-access-q446l\") pod \"ingress-canary-pgrtd\" (UID: \"61211961-5730-4d10-a011-bde3efb0be25\") " pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.408874 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.408843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgrtd"
Jul 09 09:33:21.542594 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.542417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgrtd"]
Jul 09 09:33:21.547143 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:21.547115    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61211961_5730_4d10_a011_bde3efb0be25.slice/crio-4f122c2fd0913880579170eb4697d673a0a7192b1092d11ddef35069fe6943e8 WatchSource:0}: Error finding container 4f122c2fd0913880579170eb4697d673a0a7192b1092d11ddef35069fe6943e8: Status 404 returned error can't find the container with id 4f122c2fd0913880579170eb4697d673a0a7192b1092d11ddef35069fe6943e8
Jul 09 09:33:21.735264 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.735187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:21.735414 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.735338    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 09:33:21.735414 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.735366    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6694cb7cf-6zz5n: secret "image-registry-tls" not found
Jul 09 09:33:21.735522 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.735442    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls podName:7d16c692-0095-4628-b98a-3754b4d84ee1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:22.735422074 +0000 UTC m=+37.469297735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls") pod "image-registry-6694cb7cf-6zz5n" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1") : secret "image-registry-tls" not found
Jul 09 09:33:21.836096 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:21.836039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:21.836466 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.836165    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 09:33:21.836466 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:21.836233    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls podName:183388ee-280b-416c-ae5c-f22ebf11c0b0 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:22.836217759 +0000 UTC m=+37.570093424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls") pod "dns-default-86td2" (UID: "183388ee-280b-416c-ae5c-f22ebf11c0b0") : secret "dns-default-metrics-tls" not found
Jul 09 09:33:22.073138 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.073048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgrtd" event={"ID":"61211961-5730-4d10-a011-bde3efb0be25","Type":"ContainerStarted","Data":"4f122c2fd0913880579170eb4697d673a0a7192b1092d11ddef35069fe6943e8"}
Jul 09 09:33:22.744057 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.744025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:22.744286 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:22.744207    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 09:33:22.744286 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:22.744228    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6694cb7cf-6zz5n: secret "image-registry-tls" not found
Jul 09 09:33:22.744388 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:22.744295    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls podName:7d16c692-0095-4628-b98a-3754b4d84ee1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:24.744275419 +0000 UTC m=+39.478151097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls") pod "image-registry-6694cb7cf-6zz5n" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1") : secret "image-registry-tls" not found
Jul 09 09:33:22.750118 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.750075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:22.750322 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.750075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:22.750322 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.750253    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:22.753134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.753073    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 09:33:22.753134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.753119    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 09:33:22.753335 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.753150    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 09:33:22.754449 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.754390    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sb7qz\""
Jul 09 09:33:22.754449 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.754432    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 09:33:22.754449 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.754440    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-btgg6\""
Jul 09 09:33:22.845305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:22.845261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:22.845702 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:22.845403    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 09:33:22.845702 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:22.845474    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls podName:183388ee-280b-416c-ae5c-f22ebf11c0b0 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:24.845457257 +0000 UTC m=+39.579332922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls") pod "dns-default-86td2" (UID: "183388ee-280b-416c-ae5c-f22ebf11c0b0") : secret "dns-default-metrics-tls" not found
Jul 09 09:33:24.761825 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:24.761786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:24.762451 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:24.761978    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 09:33:24.762451 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:24.762001    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6694cb7cf-6zz5n: secret "image-registry-tls" not found
Jul 09 09:33:24.762451 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:24.762095    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls podName:7d16c692-0095-4628-b98a-3754b4d84ee1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:28.762066743 +0000 UTC m=+43.495942406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls") pod "image-registry-6694cb7cf-6zz5n" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1") : secret "image-registry-tls" not found
Jul 09 09:33:24.863190 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:24.863150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:24.863361 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:24.863345    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 09:33:24.863436 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:24.863424    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls podName:183388ee-280b-416c-ae5c-f22ebf11c0b0 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:28.863402857 +0000 UTC m=+43.597278524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls") pod "dns-default-86td2" (UID: "183388ee-280b-416c-ae5c-f22ebf11c0b0") : secret "dns-default-metrics-tls" not found
Jul 09 09:33:25.705467 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:25.705433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:25.793706 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:25.793633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:26.084837 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:26.084804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgrtd" event={"ID":"61211961-5730-4d10-a011-bde3efb0be25","Type":"ContainerStarted","Data":"a60000173418bbe5f42373348cb3ed8249c2376c5e3caff4f9ecb661343091cf"}
Jul 09 09:33:26.087354 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:26.087330    2563 generic.go:356] "Generic (PLEG): container finished" podID="050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe" containerID="bcfd3bb35bc7ea44833319e648bb6812bf3610197b1a671312f39a92115bebd7" exitCode=0
Jul 09 09:33:26.087466 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:26.087368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerDied","Data":"bcfd3bb35bc7ea44833319e648bb6812bf3610197b1a671312f39a92115bebd7"}
Jul 09 09:33:26.103213 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:26.103177    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pgrtd" podStartSLOduration=1.160395414 podStartE2EDuration="5.103164906s" totalImagesPullingTime="3.942769492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:26.10226505 +0000 UTC m=+40.836140733" watchObservedRunningTime="2026-07-09 09:33:26.103164906 +0000 UTC m=+40.837040588"
Jul 09 09:33:27.093123 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:27.093074    2563 generic.go:356] "Generic (PLEG): container finished" podID="050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe" containerID="4ed48dbc030228a4ca89b9db807d41d139ca75f774b88afaa06fcd145a177a04" exitCode=0
Jul 09 09:33:27.093123 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:27.093109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerDied","Data":"4ed48dbc030228a4ca89b9db807d41d139ca75f774b88afaa06fcd145a177a04"}
Jul 09 09:33:28.098853 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:28.098814    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" event={"ID":"050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe","Type":"ContainerStarted","Data":"290502f0480fee5a40bae90529257af2dfe12a7e4a3b359660740eacf132d312"}
Jul 09 09:33:28.123720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:28.123676    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k4w7s" podStartSLOduration=5.976949933 podStartE2EDuration="42.12366002s" totalImagesPullingTime="36.146710087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:28.123048136 +0000 UTC m=+42.856923819" watchObservedRunningTime="2026-07-09 09:33:28.12366002 +0000 UTC m=+42.857535713"
Jul 09 09:33:28.252021 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:28.251987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:28.347461 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:28.347432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:28.792564 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:28.792533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:28.792722 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:28.792693    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 09:33:28.792722 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:28.792714    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6694cb7cf-6zz5n: secret "image-registry-tls" not found
Jul 09 09:33:28.792842 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:28.792779    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls podName:7d16c692-0095-4628-b98a-3754b4d84ee1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:36.792759759 +0000 UTC m=+51.526635420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls") pod "image-registry-6694cb7cf-6zz5n" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1") : secret "image-registry-tls" not found
Jul 09 09:33:28.892838 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:28.892811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:28.892983 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:28.892928    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 09:33:28.893044 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:28.892989    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls podName:183388ee-280b-416c-ae5c-f22ebf11c0b0 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:36.892970859 +0000 UTC m=+51.626846525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls") pod "dns-default-86td2" (UID: "183388ee-280b-416c-ae5c-f22ebf11c0b0") : secret "dns-default-metrics-tls" not found
Jul 09 09:33:31.611413 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:31.611377    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:31.668660 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:31.668628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:35.602740 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:35.602711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:35.722161 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:35.722124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:35.789785 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:35.789738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:35.856569 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:35.856476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:35.955817 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:35.955788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:36.055152 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.055115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:36.180883 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.180785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:36.253706 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.253676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:36.319714 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.319663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:36.615235 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.615203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:36.672161 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.672133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:36.852783 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.852749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:36.852943 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:36.852890    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 09:33:36.852943 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:36.852911    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6694cb7cf-6zz5n: secret "image-registry-tls" not found
Jul 09 09:33:36.853016 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:36.852972    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls podName:7d16c692-0095-4628-b98a-3754b4d84ee1 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:52.852957756 +0000 UTC m=+67.586833420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls") pod "image-registry-6694cb7cf-6zz5n" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1") : secret "image-registry-tls" not found
Jul 09 09:33:36.953374 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:36.953296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:36.953522 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:36.953403    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 09:33:36.953522 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:36.953451    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls podName:183388ee-280b-416c-ae5c-f22ebf11c0b0 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:52.953438202 +0000 UTC m=+67.687313863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls") pod "dns-default-86td2" (UID: "183388ee-280b-416c-ae5c-f22ebf11c0b0") : secret "dns-default-metrics-tls" not found
Jul 09 09:33:37.002358 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:37.002329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:37.106652 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:37.106612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:37.804390 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:37.804355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:37.918349 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:37.918311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:38.198258 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:38.198224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:38.298389 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:38.298361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:42.025248 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.025216    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"]
Jul 09 09:33:42.027640 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.027618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.027984 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.027955    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57cd4dc8f-dv5pd"]
Jul 09 09:33:42.029443 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.029421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.030498 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.030481    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 09 09:33:42.030787 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.030770    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.031058 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.031042    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 09 09:33:42.031166 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.031060    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c9tc6\""
Jul 09 09:33:42.031336 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.031321    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.031798 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.031783    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.032044 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.032033    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 09:33:42.032321 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.032306    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 09:33:42.032630 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.032616    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 09:33:42.032855 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.032844    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.032896 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.032845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-msmr4\""
Jul 09 09:33:42.032896 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.032870    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 09:33:42.041438 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.041413    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"]
Jul 09 09:33:42.042660 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.042633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57cd4dc8f-dv5pd"]
Jul 09 09:33:42.132211 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.132182    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"]
Jul 09 09:33:42.133925 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.133911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:42.136842 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.136813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.136842 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.136841    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.137093 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.137069    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vx74x\""
Jul 09 09:33:42.137148 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.137124    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 09:33:42.141660 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.141637    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bfvcl"]
Jul 09 09:33:42.143421 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.143405    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"]
Jul 09 09:33:42.143536 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.143521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.145222 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.145205    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"]
Jul 09 09:33:42.145356 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.145341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.147140 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.147119    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-652rx\""
Jul 09 09:33:42.147529 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.147512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.148002 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.147982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.148070 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.147983    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.148273 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.148258    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 09:33:42.148552 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.148538    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 09:33:42.149622 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.149604    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"]
Jul 09 09:33:42.152624 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.152605    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 09:33:42.153623 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.153567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.153623 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.153589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2lxtr\""
Jul 09 09:33:42.153787 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.153667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 09:33:42.154187 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.154164    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.154250 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.154238    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.154250 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.154180    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2pfvq\""
Jul 09 09:33:42.154360 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.154269    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 09:33:42.154360 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.154311    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 09:33:42.154463 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.154378    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.158112 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.158095    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 09:33:42.163863 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.163845    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"]
Jul 09 09:33:42.164857 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.164837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bfvcl"]
Jul 09 09:33:42.165952 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.165931    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"]
Jul 09 09:33:42.191399 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-default-certificate\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.191531 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.191531 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-config\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.191531 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hzh2\" (UniqueName: \"kubernetes.io/projected/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-kube-api-access-7hzh2\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.191531 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/8d46f86e-d446-465d-a65f-b2654c62dc33-kube-api-access-tgxqs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.191531 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.191770 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-stats-auth\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.191770 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.191613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.195888 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.195866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:42.234531 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.234493    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jxt6q"]
Jul 09 09:33:42.236796 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.236776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"]
Jul 09 09:33:42.236946 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.236929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.239514 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.239493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"
Jul 09 09:33:42.239795 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.239777    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 09:33:42.239885 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.239858    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.239885 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.239864    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zmpvh\""
Jul 09 09:33:42.239997 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.239891    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.239997 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.239877    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 09:33:42.243378 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.243360    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ph8xf\""
Jul 09 09:33:42.243569 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.243545    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:42.243895 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.243873    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 09:33:42.249631 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.249609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"]
Jul 09 09:33:42.250397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.250372    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 09:33:42.250862 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.250843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jxt6q"]
Jul 09 09:33:42.261000 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.260976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:42.292741 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72zw7\" (UniqueName: \"kubernetes.io/projected/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-kube-api-access-72zw7\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:42.292741 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-default-certificate\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.292741 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-config\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hzh2\" (UniqueName: \"kubernetes.io/projected/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-kube-api-access-7hzh2\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/8d46f86e-d446-465d-a65f-b2654c62dc33-kube-api-access-tgxqs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ebf28d7-9183-417d-852a-5fb7d651c0eb-config\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ebf28d7-9183-417d-852a-5fb7d651c0eb-trusted-ca\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.292932    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 09:33:42.292950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.292979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-stats-auth\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.293001    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:42.792979879 +0000 UTC m=+57.526855562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : secret "router-metrics-certs-default" not found
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj85c\" (UniqueName: \"kubernetes.io/projected/8ebf28d7-9183-417d-852a-5fb7d651c0eb-kube-api-access-mj85c\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmfcg\" (UniqueName: \"kubernetes.io/projected/356d261a-480d-461f-8262-aff9e6e0aa15-kube-api-access-hmfcg\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ebf28d7-9183-417d-852a-5fb7d651c0eb-serving-cert\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293297    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-config\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.293309    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:42.793290339 +0000 UTC m=+57.527166021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : configmap references non-existent config key: service-ca.crt
Jul 09 09:33:42.293397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45pf\" (UniqueName: \"kubernetes.io/projected/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-kube-api-access-c45pf\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.293743 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/356d261a-480d-461f-8262-aff9e6e0aa15-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.293743 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.293743 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.293504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.295654 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.295622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.295853 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.295835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-default-certificate\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.295916 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.295900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-stats-auth\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.301798 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.301770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/8d46f86e-d446-465d-a65f-b2654c62dc33-kube-api-access-tgxqs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.302510 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.302494    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hzh2\" (UniqueName: \"kubernetes.io/projected/a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa-kube-api-access-7hzh2\") pod \"service-ca-operator-5d46d9ffd4-fcsbg\" (UID: \"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.338929 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.338900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"
Jul 09 09:33:42.393873 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.393843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.393997 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.393904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72zw7\" (UniqueName: \"kubernetes.io/projected/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-kube-api-access-72zw7\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:42.393997 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.393940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.393997 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.393951    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:42.393997 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.393985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:42.394192 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.394008    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls podName:356d261a-480d-461f-8262-aff9e6e0aa15 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:42.893992247 +0000 UTC m=+57.627867912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-27p4f" (UID: "356d261a-480d-461f-8262-aff9e6e0aa15") : secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:42.394192 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdt6\" (UniqueName: \"kubernetes.io/projected/ad36c019-17af-4898-b4c8-33680b4da149-kube-api-access-mzdt6\") pod \"volume-data-source-validator-5d456fdbcd-gj6rk\" (UID: \"ad36c019-17af-4898-b4c8-33680b4da149\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"
Jul 09 09:33:42.394192 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ebf28d7-9183-417d-852a-5fb7d651c0eb-config\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.394192 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.394093    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 09:33:42.394192 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.394129    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls podName:b1b3ed23-d19d-44b6-a73f-da170a5a4c98 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:42.894122791 +0000 UTC m=+57.627998452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9mnbh" (UID: "b1b3ed23-d19d-44b6-a73f-da170a5a4c98") : secret "samples-operator-tls" not found
Jul 09 09:33:42.394430 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ebf28d7-9183-417d-852a-5fb7d651c0eb-trusted-ca\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.394430 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.394430 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.394430 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-snapshots\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.394430 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-serving-cert\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.394724 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.394724 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-tmp\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.394724 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj85c\" (UniqueName: \"kubernetes.io/projected/8ebf28d7-9183-417d-852a-5fb7d651c0eb-kube-api-access-mj85c\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.394724 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394647    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ebf28d7-9183-417d-852a-5fb7d651c0eb-config\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.394724 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmfcg\" (UniqueName: \"kubernetes.io/projected/356d261a-480d-461f-8262-aff9e6e0aa15-kube-api-access-hmfcg\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.394977 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ebf28d7-9183-417d-852a-5fb7d651c0eb-serving-cert\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.394977 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45pf\" (UniqueName: \"kubernetes.io/projected/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-kube-api-access-c45pf\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.394977 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/356d261a-480d-461f-8262-aff9e6e0aa15-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.394977 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rc49\" (UniqueName: \"kubernetes.io/projected/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-kube-api-access-8rc49\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.394977 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.394961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.395329 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.395036    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ebf28d7-9183-417d-852a-5fb7d651c0eb-trusted-ca\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.395696 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.395673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/356d261a-480d-461f-8262-aff9e6e0aa15-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.397777 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.397757    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ebf28d7-9183-417d-852a-5fb7d651c0eb-serving-cert\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.397860 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.397755    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.406496 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.406472    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45pf\" (UniqueName: \"kubernetes.io/projected/832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6-kube-api-access-c45pf\") pod \"kube-storage-version-migrator-operator-846bf668f7-x5tvq\" (UID: \"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.406599 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.406513    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj85c\" (UniqueName: \"kubernetes.io/projected/8ebf28d7-9183-417d-852a-5fb7d651c0eb-kube-api-access-mj85c\") pod \"console-operator-68b757fb67-bfvcl\" (UID: \"8ebf28d7-9183-417d-852a-5fb7d651c0eb\") " pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.406970 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.406949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmfcg\" (UniqueName: \"kubernetes.io/projected/356d261a-480d-461f-8262-aff9e6e0aa15-kube-api-access-hmfcg\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.407015 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.406976    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72zw7\" (UniqueName: \"kubernetes.io/projected/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-kube-api-access-72zw7\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:42.454428 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.454396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:42.467075 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.467052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"
Jul 09 09:33:42.483330 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.483302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg"]
Jul 09 09:33:42.486974 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:42.486948    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fe8f4f_d202_4e32_b309_e3ebdcaba7fa.slice/crio-8e00e640095c59418ef0757b172f6740422af91b42f82a79d52e69765c9f8b38 WatchSource:0}: Error finding container 8e00e640095c59418ef0757b172f6740422af91b42f82a79d52e69765c9f8b38: Status 404 returned error can't find the container with id 8e00e640095c59418ef0757b172f6740422af91b42f82a79d52e69765c9f8b38
Jul 09 09:33:42.495974 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.495945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rc49\" (UniqueName: \"kubernetes.io/projected/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-kube-api-access-8rc49\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.496070 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.496128 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdt6\" (UniqueName: \"kubernetes.io/projected/ad36c019-17af-4898-b4c8-33680b4da149-kube-api-access-mzdt6\") pod \"volume-data-source-validator-5d456fdbcd-gj6rk\" (UID: \"ad36c019-17af-4898-b4c8-33680b4da149\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"
Jul 09 09:33:42.496208 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-snapshots\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.496274 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-serving-cert\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.496274 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.496369 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-tmp\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.497003 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496945    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-tmp\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.497003 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.496960    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-snapshots\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.497204 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.497066    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.497352 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.497333    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.498452 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.498431    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-serving-cert\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.506631 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.506579    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdt6\" (UniqueName: \"kubernetes.io/projected/ad36c019-17af-4898-b4c8-33680b4da149-kube-api-access-mzdt6\") pod \"volume-data-source-validator-5d456fdbcd-gj6rk\" (UID: \"ad36c019-17af-4898-b4c8-33680b4da149\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"
Jul 09 09:33:42.506736 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.506652    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rc49\" (UniqueName: \"kubernetes.io/projected/b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e-kube-api-access-8rc49\") pod \"insights-operator-5c847dcfc4-jxt6q\" (UID: \"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e\") " pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.549693 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.549445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q"
Jul 09 09:33:42.555684 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.555655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"
Jul 09 09:33:42.587238 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.587209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bfvcl"]
Jul 09 09:33:42.590489 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:42.590444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebf28d7_9183_417d_852a_5fb7d651c0eb.slice/crio-a0199f2929c4004670609a678757e4070efaa89ec6641ff1bfb243b6ccd5da2d WatchSource:0}: Error finding container a0199f2929c4004670609a678757e4070efaa89ec6641ff1bfb243b6ccd5da2d: Status 404 returned error can't find the container with id a0199f2929c4004670609a678757e4070efaa89ec6641ff1bfb243b6ccd5da2d
Jul 09 09:33:42.603832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.603679    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq"]
Jul 09 09:33:42.609769 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:42.608490    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832e8ca3_bce9_4a3d_9d4f_af0fa0dfa7a6.slice/crio-12da941cf022e93dd70bd893b0f3f777a43fe5bbdb706909be520b93459d87da WatchSource:0}: Error finding container 12da941cf022e93dd70bd893b0f3f777a43fe5bbdb706909be520b93459d87da: Status 404 returned error can't find the container with id 12da941cf022e93dd70bd893b0f3f777a43fe5bbdb706909be520b93459d87da
Jul 09 09:33:42.684091 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.684057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jxt6q"]
Jul 09 09:33:42.686448 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:42.686419    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d7dbd1_78f8_427e_a3ec_dd4ed1f3e59e.slice/crio-66efa2422acf03eff873e14844a725bb778f08608fe03b2929219fcff0996ed2 WatchSource:0}: Error finding container 66efa2422acf03eff873e14844a725bb778f08608fe03b2929219fcff0996ed2: Status 404 returned error can't find the container with id 66efa2422acf03eff873e14844a725bb778f08608fe03b2929219fcff0996ed2
Jul 09 09:33:42.697618 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.697594    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk"]
Jul 09 09:33:42.700479 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:42.700457    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad36c019_17af_4898_b4c8_33680b4da149.slice/crio-070f928e6226981290baf9658aa9c0258e19db1e42cb7cc4e933a9a4b07aec14 WatchSource:0}: Error finding container 070f928e6226981290baf9658aa9c0258e19db1e42cb7cc4e933a9a4b07aec14: Status 404 returned error can't find the container with id 070f928e6226981290baf9658aa9c0258e19db1e42cb7cc4e933a9a4b07aec14
Jul 09 09:33:42.798250 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.798173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.798250 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.798216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:42.798421 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.798315    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 09:33:42.798421 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.798375    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:43.79835958 +0000 UTC m=+58.532235244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : secret "router-metrics-certs-default" not found
Jul 09 09:33:42.798421 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.798388    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:43.798382333 +0000 UTC m=+58.532257994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : configmap references non-existent config key: service-ca.crt
Jul 09 09:33:42.899322 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.899283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:42.899516 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:42.899341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:42.899516 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.899452    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:42.899627 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.899532    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls podName:356d261a-480d-461f-8262-aff9e6e0aa15 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:43.899512321 +0000 UTC m=+58.633387999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-27p4f" (UID: "356d261a-480d-461f-8262-aff9e6e0aa15") : secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:42.899627 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.899456    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 09:33:42.899627 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:42.899587    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls podName:b1b3ed23-d19d-44b6-a73f-da170a5a4c98 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:43.899575262 +0000 UTC m=+58.633450927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9mnbh" (UID: "b1b3ed23-d19d-44b6-a73f-da170a5a4c98") : secret "samples-operator-tls" not found
Jul 09 09:33:43.134549 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.134479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq" event={"ID":"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6","Type":"ContainerStarted","Data":"12da941cf022e93dd70bd893b0f3f777a43fe5bbdb706909be520b93459d87da"}
Jul 09 09:33:43.135924 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.135893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" event={"ID":"8ebf28d7-9183-417d-852a-5fb7d651c0eb","Type":"ContainerStarted","Data":"a0199f2929c4004670609a678757e4070efaa89ec6641ff1bfb243b6ccd5da2d"}
Jul 09 09:33:43.137174 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.137144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk" event={"ID":"ad36c019-17af-4898-b4c8-33680b4da149","Type":"ContainerStarted","Data":"070f928e6226981290baf9658aa9c0258e19db1e42cb7cc4e933a9a4b07aec14"}
Jul 09 09:33:43.138894 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.138821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q" event={"ID":"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e","Type":"ContainerStarted","Data":"66efa2422acf03eff873e14844a725bb778f08608fe03b2929219fcff0996ed2"}
Jul 09 09:33:43.140148 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.140101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg" event={"ID":"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa","Type":"ContainerStarted","Data":"8e00e640095c59418ef0757b172f6740422af91b42f82a79d52e69765c9f8b38"}
Jul 09 09:33:43.808273 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.808235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:43.808454 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.808301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:43.808517 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:43.808455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:45.808435508 +0000 UTC m=+60.542311179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : configmap references non-existent config key: service-ca.crt
Jul 09 09:33:43.808946 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:43.808860    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 09:33:43.808946 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:43.808915    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:45.808899429 +0000 UTC m=+60.542775094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : secret "router-metrics-certs-default" not found
Jul 09 09:33:43.909437 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.909387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:43.909700 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:43.909478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:43.909700 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:43.909646    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 09:33:43.909820 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:43.909706    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls podName:b1b3ed23-d19d-44b6-a73f-da170a5a4c98 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:45.909688105 +0000 UTC m=+60.643563783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9mnbh" (UID: "b1b3ed23-d19d-44b6-a73f-da170a5a4c98") : secret "samples-operator-tls" not found
Jul 09 09:33:43.910241 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:43.910132    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:43.910241 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:43.910195    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls podName:356d261a-480d-461f-8262-aff9e6e0aa15 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:45.910179922 +0000 UTC m=+60.644055589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-27p4f" (UID: "356d261a-480d-461f-8262-aff9e6e0aa15") : secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:45.827134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:45.827104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:45.827514 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:45.827156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:45.827514 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:45.827237    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 09:33:45.827514 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:45.827311    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:49.827291234 +0000 UTC m=+64.561166912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : secret "router-metrics-certs-default" not found
Jul 09 09:33:45.827514 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:45.827332    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:49.827321754 +0000 UTC m=+64.561197445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : configmap references non-existent config key: service-ca.crt
Jul 09 09:33:45.928476 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:45.928436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:45.928675 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:45.928511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:45.928675 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:45.928589    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:45.928675 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:45.928622    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 09:33:45.928675 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:45.928663    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls podName:356d261a-480d-461f-8262-aff9e6e0aa15 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:49.928647817 +0000 UTC m=+64.662523478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-27p4f" (UID: "356d261a-480d-461f-8262-aff9e6e0aa15") : secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:45.928675 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:45.928678    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls podName:b1b3ed23-d19d-44b6-a73f-da170a5a4c98 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:49.928671741 +0000 UTC m=+64.662547402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9mnbh" (UID: "b1b3ed23-d19d-44b6-a73f-da170a5a4c98") : secret "samples-operator-tls" not found
Jul 09 09:33:46.054439 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.054407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"]
Jul 09 09:33:46.056794 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.056772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"
Jul 09 09:33:46.060780 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.060754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dsppm\""
Jul 09 09:33:46.072114 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.072092    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"]
Jul 09 09:33:46.129950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.129896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz7bp\" (UniqueName: \"kubernetes.io/projected/4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7-kube-api-access-lz7bp\") pod \"network-check-source-989f8b8dc-6m8vm\" (UID: \"4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"
Jul 09 09:33:46.234275 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.231122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz7bp\" (UniqueName: \"kubernetes.io/projected/4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7-kube-api-access-lz7bp\") pod \"network-check-source-989f8b8dc-6m8vm\" (UID: \"4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"
Jul 09 09:33:46.240063 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.239864    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 09:33:46.250422 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.250341    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 09:33:46.260838 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.260809    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz7bp\" (UniqueName: \"kubernetes.io/projected/4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7-kube-api-access-lz7bp\") pod \"network-check-source-989f8b8dc-6m8vm\" (UID: \"4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"
Jul 09 09:33:46.367790 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.367750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"
Jul 09 09:33:46.498848 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:46.498813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm"]
Jul 09 09:33:46.501765 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:46.501734    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4d7baf_d362_4c9c_96aa_0e1e4de08ad7.slice/crio-1d831d0ad403db6671866702c419fccb3fa50da5bc04538a085672cb8d806e4c WatchSource:0}: Error finding container 1d831d0ad403db6671866702c419fccb3fa50da5bc04538a085672cb8d806e4c: Status 404 returned error can't find the container with id 1d831d0ad403db6671866702c419fccb3fa50da5bc04538a085672cb8d806e4c
Jul 09 09:33:47.068306 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.068024    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9479k"
Jul 09 09:33:47.155258 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.155221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg" event={"ID":"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa","Type":"ContainerStarted","Data":"2fd06391e11e6c13b2699fb0c3db553aaeebe971146b38715878172f11ae411a"}
Jul 09 09:33:47.157529 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.157107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq" event={"ID":"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6","Type":"ContainerStarted","Data":"bf3fb49591dec63ed6177d3a27dfddec32cd8baaa32a4ecbae823a6469cdeabc"}
Jul 09 09:33:47.159382 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.159361    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/0.log"
Jul 09 09:33:47.159507 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.159399    2563 generic.go:356] "Generic (PLEG): container finished" podID="8ebf28d7-9183-417d-852a-5fb7d651c0eb" containerID="4cf2fb56f9445a5ffa172b161b6c95c086c34cfb4ae41d6d8276c62646719ffc" exitCode=255
Jul 09 09:33:47.159697 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.159683    2563 scope.go:117] "RemoveContainer" containerID="4cf2fb56f9445a5ffa172b161b6c95c086c34cfb4ae41d6d8276c62646719ffc"
Jul 09 09:33:47.159806 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.159783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" event={"ID":"8ebf28d7-9183-417d-852a-5fb7d651c0eb","Type":"ContainerDied","Data":"4cf2fb56f9445a5ffa172b161b6c95c086c34cfb4ae41d6d8276c62646719ffc"}
Jul 09 09:33:47.161644 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.161601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm" event={"ID":"4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7","Type":"ContainerStarted","Data":"1d831d0ad403db6671866702c419fccb3fa50da5bc04538a085672cb8d806e4c"}
Jul 09 09:33:47.163357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.163333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk" event={"ID":"ad36c019-17af-4898-b4c8-33680b4da149","Type":"ContainerStarted","Data":"7ae154b846428f5a75ed4929e4a8d427e3ada2d6e13b16444e1fde1a8872b33e"}
Jul 09 09:33:47.166100 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.165752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q" event={"ID":"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e","Type":"ContainerStarted","Data":"a07978ee2b8be17548bc223fb29d511f2bfb8b7ba9df92f592c4933a862ac874"}
Jul 09 09:33:47.173453 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.173384    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg" podStartSLOduration=1.439228011 podStartE2EDuration="5.173366035s" totalImagesPullingTime="3.734138024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:47.172298757 +0000 UTC m=+61.906174441" watchObservedRunningTime="2026-07-09 09:33:47.173366035 +0000 UTC m=+61.907241698"
Jul 09 09:33:47.208502 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.208215    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gj6rk" podStartSLOduration=1.694916569 podStartE2EDuration="5.208195635s" totalImagesPullingTime="3.513279066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:47.207019384 +0000 UTC m=+61.940895068" watchObservedRunningTime="2026-07-09 09:33:47.208195635 +0000 UTC m=+61.942071318"
Jul 09 09:33:47.232132 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.231467    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq" podStartSLOduration=1.622942019 podStartE2EDuration="5.231447338s" totalImagesPullingTime="3.608505319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:47.230244264 +0000 UTC m=+61.964119950" watchObservedRunningTime="2026-07-09 09:33:47.231447338 +0000 UTC m=+61.965323022"
Jul 09 09:33:47.232880 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.232809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:47.253994 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.253944    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q" podStartSLOduration=1.718159683 podStartE2EDuration="5.253922528s" totalImagesPullingTime="3.535762845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:47.253383471 +0000 UTC m=+61.987259154" watchObservedRunningTime="2026-07-09 09:33:47.253922528 +0000 UTC m=+61.987798213"
Jul 09 09:33:47.326589 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.326510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:47.440048 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.438371    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hk2kv"]
Jul 09 09:33:47.442745 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.442696    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.447073 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.446799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 09:33:47.448005 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.447324    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sxdgx\""
Jul 09 09:33:47.448005 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.447556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 09:33:47.469942 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.466651    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk2kv"]
Jul 09 09:33:47.488804 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.488776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:47.546068 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.546034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbsz9\" (UniqueName: \"kubernetes.io/projected/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-api-access-xbsz9\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.546228 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.546122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.546228 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.546162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c1d19f-e1de-4085-b760-c889d7ad459c-data-volume\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.546349 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.546255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.546349 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.546295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40c1d19f-e1de-4085-b760-c889d7ad459c-crio-socket\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.560330 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.560298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:47.646856 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.646828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbsz9\" (UniqueName: \"kubernetes.io/projected/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-api-access-xbsz9\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.647039 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.646896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.647039 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.646932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c1d19f-e1de-4085-b760-c889d7ad459c-data-volume\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.647039 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.646965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.647039 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.646992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40c1d19f-e1de-4085-b760-c889d7ad459c-crio-socket\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.647299 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.647143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40c1d19f-e1de-4085-b760-c889d7ad459c-crio-socket\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.647299 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:47.647205    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:47.647299 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:47.647216    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 09:33:47.647299 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:47.647257    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:48.147242632 +0000 UTC m=+62.881118297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:47.647299 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:47.647272    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:48.147265154 +0000 UTC m=+62.881140814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : configmap "kube-rbac-proxy" not found
Jul 09 09:33:47.647519 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.647443    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c1d19f-e1de-4085-b760-c889d7ad459c-data-volume\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.655711 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.655686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbsz9\" (UniqueName: \"kubernetes.io/projected/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-api-access-xbsz9\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:47.885992 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:47.885943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:48.152064 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.152029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:48.152483 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.152111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:48.152483 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:48.152203    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:48.152483 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:48.152227    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 09:33:48.152483 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:48.152281    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:49.152264872 +0000 UTC m=+63.886140536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:48.152483 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:48.152297    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:49.152290537 +0000 UTC m=+63.886166197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : configmap "kube-rbac-proxy" not found
Jul 09 09:33:48.171349 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.171323    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/1.log"
Jul 09 09:33:48.171824 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.171804    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/0.log"
Jul 09 09:33:48.171928 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.171843    2563 generic.go:356] "Generic (PLEG): container finished" podID="8ebf28d7-9183-417d-852a-5fb7d651c0eb" containerID="a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9" exitCode=255
Jul 09 09:33:48.171928 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.171876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" event={"ID":"8ebf28d7-9183-417d-852a-5fb7d651c0eb","Type":"ContainerDied","Data":"a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9"}
Jul 09 09:33:48.172045 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.171937    2563 scope.go:117] "RemoveContainer" containerID="4cf2fb56f9445a5ffa172b161b6c95c086c34cfb4ae41d6d8276c62646719ffc"
Jul 09 09:33:48.172212 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.172196    2563 scope.go:117] "RemoveContainer" containerID="a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9"
Jul 09 09:33:48.172378 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:48.172356    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bfvcl_openshift-console-operator(8ebf28d7-9183-417d-852a-5fb7d651c0eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" podUID="8ebf28d7-9183-417d-852a-5fb7d651c0eb"
Jul 09 09:33:48.339732 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.339686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:48.426208 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.426125    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"]
Jul 09 09:33:48.429031 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.428991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:48.455570 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.455549    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mw588_68bac4a3-fae4-4839-8d41-617087c1f3a3/dns-node-resolver/0.log"
Jul 09 09:33:48.459131 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.459102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"]
Jul 09 09:33:48.459248 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.459185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"
Jul 09 09:33:48.462257 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.462225    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sl978\""
Jul 09 09:33:48.462440 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.462255    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 09:33:48.462440 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.462270    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:48.502043 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.502022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:48.556262 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.556232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nklmw\" (UniqueName: \"kubernetes.io/projected/9a241936-19d2-436c-a5c0-9debc6694df1-kube-api-access-nklmw\") pod \"migrator-d57d58cc9-p645z\" (UID: \"9a241936-19d2-436c-a5c0-9debc6694df1\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"
Jul 09 09:33:48.595108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.595047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:48.657301 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.657267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nklmw\" (UniqueName: \"kubernetes.io/projected/9a241936-19d2-436c-a5c0-9debc6694df1-kube-api-access-nklmw\") pod \"migrator-d57d58cc9-p645z\" (UID: \"9a241936-19d2-436c-a5c0-9debc6694df1\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"
Jul 09 09:33:48.666832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.666799    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nklmw\" (UniqueName: \"kubernetes.io/projected/9a241936-19d2-436c-a5c0-9debc6694df1-kube-api-access-nklmw\") pod \"migrator-d57d58cc9-p645z\" (UID: \"9a241936-19d2-436c-a5c0-9debc6694df1\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"
Jul 09 09:33:48.700340 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.700275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:48.770657 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:48.770626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"
Jul 09 09:33:49.161814 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.161776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:49.162284 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.161842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:49.162284 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.161938    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:49.162284 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.161985    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 09:33:49.162284 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.162021    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:51.16199893 +0000 UTC m=+65.895874594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:49.162284 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.162063    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:51.162044009 +0000 UTC m=+65.895919676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : configmap "kube-rbac-proxy" not found
Jul 09 09:33:49.177192 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.177170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/1.log"
Jul 09 09:33:49.177577 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.177546    2563 scope.go:117] "RemoveContainer" containerID="a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9"
Jul 09 09:33:49.177756 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.177732    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bfvcl_openshift-console-operator(8ebf28d7-9183-417d-852a-5fb7d651c0eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" podUID="8ebf28d7-9183-417d-852a-5fb7d651c0eb"
Jul 09 09:33:49.449612 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.449531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8h2j8_10bfbad4-7044-4a4a-aa40-b2d23abb80ae/node-ca/0.log"
Jul 09 09:33:49.641022 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.640893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z"]
Jul 09 09:33:49.643760 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:49.643728    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a241936_19d2_436c_a5c0_9debc6694df1.slice/crio-a4bbf9ff22663a8606d79417ca7c542d6ac7bfb8c7cfd06692c62a1cfdb6058d WatchSource:0}: Error finding container a4bbf9ff22663a8606d79417ca7c542d6ac7bfb8c7cfd06692c62a1cfdb6058d: Status 404 returned error can't find the container with id a4bbf9ff22663a8606d79417ca7c542d6ac7bfb8c7cfd06692c62a1cfdb6058d
Jul 09 09:33:49.868965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.868933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:49.869143 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.868984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:49.869143 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.869074    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 09:33:49.869220 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.869155    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:57.869140062 +0000 UTC m=+72.603015723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : secret "router-metrics-certs-default" not found
Jul 09 09:33:49.869220 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.869179    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:57.869166865 +0000 UTC m=+72.603042530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : configmap references non-existent config key: service-ca.crt
Jul 09 09:33:49.969823 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.969787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:49.969962 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.969898    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 09:33:49.969962 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:49.969913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:49.969962 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.969946    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls podName:b1b3ed23-d19d-44b6-a73f-da170a5a4c98 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:57.969932015 +0000 UTC m=+72.703807681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9mnbh" (UID: "b1b3ed23-d19d-44b6-a73f-da170a5a4c98") : secret "samples-operator-tls" not found
Jul 09 09:33:49.970105 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.969987    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:49.970105 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:49.970032    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls podName:356d261a-480d-461f-8262-aff9e6e0aa15 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:57.970021848 +0000 UTC m=+72.703897514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-27p4f" (UID: "356d261a-480d-461f-8262-aff9e6e0aa15") : secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:50.181517 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.181431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm" event={"ID":"4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7","Type":"ContainerStarted","Data":"92aeee5018fd89c15a8e204271f8bb101b5cbb1562157a45adfa499a38326daf"}
Jul 09 09:33:50.182606 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.182579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z" event={"ID":"9a241936-19d2-436c-a5c0-9debc6694df1","Type":"ContainerStarted","Data":"a4bbf9ff22663a8606d79417ca7c542d6ac7bfb8c7cfd06692c62a1cfdb6058d"}
Jul 09 09:33:50.200231 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.200209    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-js4qm"]
Jul 09 09:33:50.200605 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.200564    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6m8vm" podStartSLOduration=1.151588922 podStartE2EDuration="4.200547251s" totalImagesPullingTime="3.048958329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:50.198072363 +0000 UTC m=+64.931948047" watchObservedRunningTime="2026-07-09 09:33:50.200547251 +0000 UTC m=+64.934422935"
Jul 09 09:33:50.202234 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.202220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.206870 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.206853    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 09:33:50.207182 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.207164    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-w2jl7\""
Jul 09 09:33:50.207239 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.207187    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 09:33:50.207898 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.207883    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 09:33:50.208100 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.208073    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 09:33:50.219478 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.219457    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-js4qm"]
Jul 09 09:33:50.239987 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.239866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:50.254050 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.254027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgrtd_61211961-5730-4d10-a011-bde3efb0be25/serve-healthcheck-canary/0.log"
Jul 09 09:33:50.272575 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.272552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/42592125-9dd3-4d9c-a132-6804f4333bba-signing-key\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.272692 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.272634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jszqs\" (UniqueName: \"kubernetes.io/projected/42592125-9dd3-4d9c-a132-6804f4333bba-kube-api-access-jszqs\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.272692 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.272676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/42592125-9dd3-4d9c-a132-6804f4333bba-signing-cabundle\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.338954 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.338897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:50.373315 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.373286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/42592125-9dd3-4d9c-a132-6804f4333bba-signing-key\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.373459 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.373354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jszqs\" (UniqueName: \"kubernetes.io/projected/42592125-9dd3-4d9c-a132-6804f4333bba-kube-api-access-jszqs\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.373459 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.373395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/42592125-9dd3-4d9c-a132-6804f4333bba-signing-cabundle\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.374275 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.374251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/42592125-9dd3-4d9c-a132-6804f4333bba-signing-cabundle\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.375653 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.375626    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/42592125-9dd3-4d9c-a132-6804f4333bba-signing-key\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.382028 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.382005    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jszqs\" (UniqueName: \"kubernetes.io/projected/42592125-9dd3-4d9c-a132-6804f4333bba-kube-api-access-jszqs\") pod \"service-ca-758f599c5-js4qm\" (UID: \"42592125-9dd3-4d9c-a132-6804f4333bba\") " pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.511564 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.511490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-js4qm"
Jul 09 09:33:50.651799 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.651756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-js4qm"]
Jul 09 09:33:50.676460 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.676306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:33:50.676460 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.676366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:50.679158 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.679129    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 09:33:50.679272 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.679178    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 09:33:50.687231 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:50.687208    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 09:33:50.687346 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:50.687285    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs podName:528db513-4644-4714-ae52-3bcdd7dc32cf nodeName:}" failed. No retries permitted until 2026-07-09 09:34:54.687265245 +0000 UTC m=+129.421140908 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs") pod "network-metrics-daemon-nwxc5" (UID: "528db513-4644-4714-ae52-3bcdd7dc32cf") : secret "metrics-daemon-secret" not found
Jul 09 09:33:50.689506 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.689489    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1ede5b3-978a-4e74-b910-b1fda01f7af1-original-pull-secret\") pod \"global-pull-secret-syncer-c8gdf\" (UID: \"a1ede5b3-978a-4e74-b910-b1fda01f7af1\") " pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:50.777418 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.777335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:50.780210 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.780182    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fwzn\" (UniqueName: \"kubernetes.io/projected/0faee550-be67-4425-b562-7c2b5ec4d14b-kube-api-access-9fwzn\") pod \"network-check-target-zj2qx\" (UID: \"0faee550-be67-4425-b562-7c2b5ec4d14b\") " pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:50.857390 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:50.857351    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42592125_9dd3_4d9c_a132_6804f4333bba.slice/crio-f73641e3f2dc50b362bbd0898498e493d693dceb2fa7553c611f2e573dc7f008 WatchSource:0}: Error finding container f73641e3f2dc50b362bbd0898498e493d693dceb2fa7553c611f2e573dc7f008: Status 404 returned error can't find the container with id f73641e3f2dc50b362bbd0898498e493d693dceb2fa7553c611f2e573dc7f008
Jul 09 09:33:50.963742 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.963718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c8gdf"
Jul 09 09:33:50.974626 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.974601    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sb7qz\""
Jul 09 09:33:50.982329 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:50.982305    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:51.108654 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.108632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c8gdf"]
Jul 09 09:33:51.110776 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:51.110747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ede5b3_978a_4e74_b910_b1fda01f7af1.slice/crio-280bc126a70a270cc7ee1b72b6844f555da2da13405cf5926d476fc6f60493bc WatchSource:0}: Error finding container 280bc126a70a270cc7ee1b72b6844f555da2da13405cf5926d476fc6f60493bc: Status 404 returned error can't find the container with id 280bc126a70a270cc7ee1b72b6844f555da2da13405cf5926d476fc6f60493bc
Jul 09 09:33:51.126727 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.126700    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zj2qx"]
Jul 09 09:33:51.129577 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:33:51.129555    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0faee550_be67_4425_b562_7c2b5ec4d14b.slice/crio-1612df5c040e80e3df54d5de89d92856bfff5cd41c421db60c017dc5d8338ecb WatchSource:0}: Error finding container 1612df5c040e80e3df54d5de89d92856bfff5cd41c421db60c017dc5d8338ecb: Status 404 returned error can't find the container with id 1612df5c040e80e3df54d5de89d92856bfff5cd41c421db60c017dc5d8338ecb
Jul 09 09:33:51.181134 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.181111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:51.181223 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.181158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:51.181258 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:51.181223    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 09:33:51.181302 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:51.181255    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:51.181302 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:51.181264    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:55.181252613 +0000 UTC m=+69.915128274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : configmap "kube-rbac-proxy" not found
Jul 09 09:33:51.181371 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:51.181309    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:33:55.181292813 +0000 UTC m=+69.915168489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:51.187737 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.187714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zj2qx" event={"ID":"0faee550-be67-4425-b562-7c2b5ec4d14b","Type":"ContainerStarted","Data":"1612df5c040e80e3df54d5de89d92856bfff5cd41c421db60c017dc5d8338ecb"}
Jul 09 09:33:51.189035 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.189010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c8gdf" event={"ID":"a1ede5b3-978a-4e74-b910-b1fda01f7af1","Type":"ContainerStarted","Data":"280bc126a70a270cc7ee1b72b6844f555da2da13405cf5926d476fc6f60493bc"}
Jul 09 09:33:51.190747 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.190728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z" event={"ID":"9a241936-19d2-436c-a5c0-9debc6694df1","Type":"ContainerStarted","Data":"8f3831c77bb8a6664309d58ce98baa613a3bd0c5bba42b63d1aeea9575e10681"}
Jul 09 09:33:51.190848 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.190772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z" event={"ID":"9a241936-19d2-436c-a5c0-9debc6694df1","Type":"ContainerStarted","Data":"6ac54b671c1d61b66edb12d33eb7dc10ad1729f356432cebe237756b185e4afd"}
Jul 09 09:33:51.192221 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.192201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-js4qm" event={"ID":"42592125-9dd3-4d9c-a132-6804f4333bba","Type":"ContainerStarted","Data":"8de3336fa8c18ce624117b2a646fc017e91211e93c18eca8fdf8b275f0f153f5"}
Jul 09 09:33:51.192307 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.192237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-js4qm" event={"ID":"42592125-9dd3-4d9c-a132-6804f4333bba","Type":"ContainerStarted","Data":"f73641e3f2dc50b362bbd0898498e493d693dceb2fa7553c611f2e573dc7f008"}
Jul 09 09:33:51.232180 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.232131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-p645z" podStartSLOduration=1.996062266 podStartE2EDuration="3.232111224s" totalImagesPullingTime="1.236048958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:51.212447038 +0000 UTC m=+65.946322722" watchObservedRunningTime="2026-07-09 09:33:51.232111224 +0000 UTC m=+65.965986908"
Jul 09 09:33:51.296653 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:51.296564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:52.197359 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.197319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zj2qx" event={"ID":"0faee550-be67-4425-b562-7c2b5ec4d14b","Type":"ContainerStarted","Data":"9a354a1ccedd2baaaa61e289b27d3360cfd40ab930e7161ffd16b819aefc527a"}
Jul 09 09:33:52.217147 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.217093    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zj2qx" podStartSLOduration=66.217057399 podStartE2EDuration="1m6.217057399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:52.214882962 +0000 UTC m=+66.948758645" watchObservedRunningTime="2026-07-09 09:33:52.217057399 +0000 UTC m=+66.950933085"
Jul 09 09:33:52.217304 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.217220    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-js4qm" podStartSLOduration=2.217214637 podStartE2EDuration="2.217214637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:51.232576795 +0000 UTC m=+65.966452478" watchObservedRunningTime="2026-07-09 09:33:52.217214637 +0000 UTC m=+66.951090337"
Jul 09 09:33:52.387855 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.387769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:52.456064 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.454935    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:52.456064 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.455026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:33:52.456064 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.455464    2563 scope.go:117] "RemoveContainer" containerID="a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9"
Jul 09 09:33:52.456064 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:52.455643    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bfvcl_openshift-console-operator(8ebf28d7-9183-417d-852a-5fb7d651c0eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" podUID="8ebf28d7-9183-417d-852a-5fb7d651c0eb"
Jul 09 09:33:52.593726 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.593620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:52.693034 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.692840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:52.793984 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.793741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:52.896817 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.896262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:33:52.896817 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:52.896405    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 09:33:52.896817 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:52.896421    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6694cb7cf-6zz5n: secret "image-registry-tls" not found
Jul 09 09:33:52.896817 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:52.896476    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls podName:7d16c692-0095-4628-b98a-3754b4d84ee1 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:24.896458171 +0000 UTC m=+99.630333846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls") pod "image-registry-6694cb7cf-6zz5n" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1") : secret "image-registry-tls" not found
Jul 09 09:33:52.990230 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.990163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:52.999682 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:52.997140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:33:52.999682 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:52.997335    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 09:33:52.999682 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:52.997393    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls podName:183388ee-280b-416c-ae5c-f22ebf11c0b0 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:24.997375164 +0000 UTC m=+99.731250830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls") pod "dns-default-86td2" (UID: "183388ee-280b-416c-ae5c-f22ebf11c0b0") : secret "dns-default-metrics-tls" not found
Jul 09 09:33:53.102369 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:53.102273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:53.202932 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:53.202383    2563 scope.go:117] "RemoveContainer" containerID="a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9"
Jul 09 09:33:53.202932 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:53.202576    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bfvcl_openshift-console-operator(8ebf28d7-9183-417d-852a-5fb7d651c0eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" podUID="8ebf28d7-9183-417d-852a-5fb7d651c0eb"
Jul 09 09:33:53.202932 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:53.202888    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:33:54.288028 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:54.287929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:54.482305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:54.482260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:54.712436 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:54.712401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:54.811424 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:54.811371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:54.915118 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:54.915068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:54.983035 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:54.982944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:55.091470 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:55.091435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:55.220383 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:55.220353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:55.220571 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:55.220414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:33:55.220571 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:55.220508    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:55.220571 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:55.220530    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 09:33:55.220744 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:55.220578    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:34:03.220557709 +0000 UTC m=+77.954433373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : secret "insights-runtime-extractor-tls" not found
Jul 09 09:33:55.220744 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:55.220601    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm podName:40c1d19f-e1de-4085-b760-c889d7ad459c nodeName:}" failed. No retries permitted until 2026-07-09 09:34:03.220588042 +0000 UTC m=+77.954463710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hk2kv" (UID: "40c1d19f-e1de-4085-b760-c889d7ad459c") : configmap "kube-rbac-proxy" not found
Jul 09 09:33:55.690488 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:55.690455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:56.106068 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:56.106035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:56.205965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:56.205937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:56.486109 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:56.486021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:56.687987 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:56.687950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:56.890034 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:56.890003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:56.991634 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:56.991603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:57.098989 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:57.098961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:57.218411 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:57.218337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c8gdf" event={"ID":"a1ede5b3-978a-4e74-b910-b1fda01f7af1","Type":"ContainerStarted","Data":"727578824d9817c7ddcd8ccae2f208943e128dc9414856cc4d031955e7adab63"}
Jul 09 09:33:57.241279 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:57.241237    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c8gdf" podStartSLOduration=64.828127104 podStartE2EDuration="1m10.241221569s" totalImagesPullingTime="5.413094465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:33:57.240980722 +0000 UTC m=+71.974856406" watchObservedRunningTime="2026-07-09 09:33:57.241221569 +0000 UTC m=+71.975097287"
Jul 09 09:33:57.891006 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:57.890971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:57.946051 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:57.946019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:57.946212 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:57.946197    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle podName:8d46f86e-d446-465d-a65f-b2654c62dc33 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:13.946170867 +0000 UTC m=+88.680046533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle") pod "router-default-57cd4dc8f-dv5pd" (UID: "8d46f86e-d446-465d-a65f-b2654c62dc33") : configmap references non-existent config key: service-ca.crt
Jul 09 09:33:57.946266 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:57.946239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:57.948570 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:57.948544    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d46f86e-d446-465d-a65f-b2654c62dc33-metrics-certs\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:33:58.047302 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.047278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:58.047452 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.047421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:33:58.047554 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:58.047538    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:58.047620 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:33:58.047605    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls podName:356d261a-480d-461f-8262-aff9e6e0aa15 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:14.047586803 +0000 UTC m=+88.781462478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-27p4f" (UID: "356d261a-480d-461f-8262-aff9e6e0aa15") : secret "cluster-monitoring-operator-tls" not found
Jul 09 09:33:58.049686 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.049663    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1b3ed23-d19d-44b6-a73f-da170a5a4c98-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9mnbh\" (UID: \"b1b3ed23-d19d-44b6-a73f-da170a5a4c98\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:58.165249 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.165167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:58.346488 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.346462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vx74x\""
Jul 09 09:33:58.354807 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.354785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"
Jul 09 09:33:58.476701 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.476673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh"]
Jul 09 09:33:58.484386 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.484359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:58.702474 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:58.702385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log" limit=1024
Jul 09 09:33:59.225568 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:33:59.225533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh" event={"ID":"b1b3ed23-d19d-44b6-a73f-da170a5a4c98","Type":"ContainerStarted","Data":"303bd516e6d6dd9d5daff45f6f5b1deafd4597479768504e6bdf3c87b060015c"}
Jul 09 09:34:02.237681 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:02.237648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh" event={"ID":"b1b3ed23-d19d-44b6-a73f-da170a5a4c98","Type":"ContainerStarted","Data":"082c1ec7bff62b5d6b4f19b6e276d27b1f51c912fd32d28c446d88932ba3f096"}
Jul 09 09:34:02.238146 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:02.237709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh" event={"ID":"b1b3ed23-d19d-44b6-a73f-da170a5a4c98","Type":"ContainerStarted","Data":"dc4142ea0bcff765200c393888d787ee8c6cf8caab152681584f43174bd8793b"}
Jul 09 09:34:02.258439 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:02.258392    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9mnbh" podStartSLOduration=17.531756032 podStartE2EDuration="20.258376517s" totalImagesPullingTime="2.726620485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:02.257361774 +0000 UTC m=+76.991237457" watchObservedRunningTime="2026-07-09 09:34:02.258376517 +0000 UTC m=+76.992252177"
Jul 09 09:34:03.289382 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:03.289345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:34:03.289759 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:03.289392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:34:03.289851 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:03.289835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40c1d19f-e1de-4085-b760-c889d7ad459c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:34:03.291874 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:03.291855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40c1d19f-e1de-4085-b760-c889d7ad459c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hk2kv\" (UID: \"40c1d19f-e1de-4085-b760-c889d7ad459c\") " pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:34:03.374295 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:03.374268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hk2kv"
Jul 09 09:34:03.528255 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:03.528230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hk2kv"]
Jul 09 09:34:03.529359 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:03.529333    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c1d19f_e1de_4085_b760_c889d7ad459c.slice/crio-38dfa295d8bf5d71ec98d7343aa89c32b7a40d6ca15bca743a4bfd5e62510fe2 WatchSource:0}: Error finding container 38dfa295d8bf5d71ec98d7343aa89c32b7a40d6ca15bca743a4bfd5e62510fe2: Status 404 returned error can't find the container with id 38dfa295d8bf5d71ec98d7343aa89c32b7a40d6ca15bca743a4bfd5e62510fe2
Jul 09 09:34:04.246805 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:04.246765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2kv" event={"ID":"40c1d19f-e1de-4085-b760-c889d7ad459c","Type":"ContainerStarted","Data":"38dfa295d8bf5d71ec98d7343aa89c32b7a40d6ca15bca743a4bfd5e62510fe2"}
Jul 09 09:34:04.750462 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:04.750432    2563 scope.go:117] "RemoveContainer" containerID="a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9"
Jul 09 09:34:05.252678 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:05.252653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:34:05.253101 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:05.253070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/1.log"
Jul 09 09:34:05.253186 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:05.253118    2563 generic.go:356] "Generic (PLEG): container finished" podID="8ebf28d7-9183-417d-852a-5fb7d651c0eb" containerID="b3805440b0d98f2879aff8af10474ca6c707a9a0510f3d194c12de85f5d780ee" exitCode=255
Jul 09 09:34:05.253186 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:05.253163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" event={"ID":"8ebf28d7-9183-417d-852a-5fb7d651c0eb","Type":"ContainerDied","Data":"b3805440b0d98f2879aff8af10474ca6c707a9a0510f3d194c12de85f5d780ee"}
Jul 09 09:34:05.253273 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:05.253215    2563 scope.go:117] "RemoveContainer" containerID="a37650ad0a2f2ce5d87e17ebc4c9ed57b6a8baa66da3d8b6fb151010ad76eae9"
Jul 09 09:34:05.253602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:05.253580    2563 scope.go:117] "RemoveContainer" containerID="b3805440b0d98f2879aff8af10474ca6c707a9a0510f3d194c12de85f5d780ee"
Jul 09 09:34:05.253817 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:34:05.253793    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-bfvcl_openshift-console-operator(8ebf28d7-9183-417d-852a-5fb7d651c0eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" podUID="8ebf28d7-9183-417d-852a-5fb7d651c0eb"
Jul 09 09:34:07.261680 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:07.261652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:34:07.263132 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:07.263107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2kv" event={"ID":"40c1d19f-e1de-4085-b760-c889d7ad459c","Type":"ContainerStarted","Data":"e59bcf1f8869188a51dc6820496b5c33b1ba3eb1d4393144c8ae12b709f17d34"}
Jul 09 09:34:08.268936 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:08.268793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2kv" event={"ID":"40c1d19f-e1de-4085-b760-c889d7ad459c","Type":"ContainerStarted","Data":"26ec8dedb54bac96ea08dec84de2c951098243d08fca6e6bb9442a8216a06bf8"}
Jul 09 09:34:10.277244 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:10.277206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hk2kv" event={"ID":"40c1d19f-e1de-4085-b760-c889d7ad459c","Type":"ContainerStarted","Data":"a5434c567e2ad527f96956ccfc3edba854fafbef6779575af655919a623b5a22"}
Jul 09 09:34:10.302395 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:10.302340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hk2kv" podStartSLOduration=16.825971639 podStartE2EDuration="23.302324791s" totalImagesPullingTime="6.476353152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:10.297384392 +0000 UTC m=+85.031260076" watchObservedRunningTime="2026-07-09 09:34:10.302324791 +0000 UTC m=+85.036200476"
Jul 09 09:34:12.455281 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.455244    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:34:12.455652 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.455296    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:34:12.455652 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.455614    2563 scope.go:117] "RemoveContainer" containerID="b3805440b0d98f2879aff8af10474ca6c707a9a0510f3d194c12de85f5d780ee"
Jul 09 09:34:12.455808 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:34:12.455789    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-bfvcl_openshift-console-operator(8ebf28d7-9183-417d-852a-5fb7d651c0eb)\"" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" podUID="8ebf28d7-9183-417d-852a-5fb7d651c0eb"
Jul 09 09:34:12.661091 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.661057    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"]
Jul 09 09:34:12.664160 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.664144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:12.668612 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.668589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s454q\""
Jul 09 09:34:12.668762 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.668742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 09:34:12.669016 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.668999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 09:34:12.676119 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.676098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"]
Jul 09 09:34:12.769305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.769231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ed15081-1fd1-40d8-aead-4a31e3a96cae-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vnqlv\" (UID: \"1ed15081-1fd1-40d8-aead-4a31e3a96cae\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:12.769305 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.769302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ed15081-1fd1-40d8-aead-4a31e3a96cae-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vnqlv\" (UID: \"1ed15081-1fd1-40d8-aead-4a31e3a96cae\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:12.870127 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.870098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ed15081-1fd1-40d8-aead-4a31e3a96cae-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vnqlv\" (UID: \"1ed15081-1fd1-40d8-aead-4a31e3a96cae\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:12.870324 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.870186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ed15081-1fd1-40d8-aead-4a31e3a96cae-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vnqlv\" (UID: \"1ed15081-1fd1-40d8-aead-4a31e3a96cae\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:12.870775 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.870750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ed15081-1fd1-40d8-aead-4a31e3a96cae-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vnqlv\" (UID: \"1ed15081-1fd1-40d8-aead-4a31e3a96cae\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:12.872520 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.872499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ed15081-1fd1-40d8-aead-4a31e3a96cae-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vnqlv\" (UID: \"1ed15081-1fd1-40d8-aead-4a31e3a96cae\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:12.973699 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:12.973664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"
Jul 09 09:34:13.103760 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:13.103731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv"]
Jul 09 09:34:13.106897 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:13.106870    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed15081_1fd1_40d8_aead_4a31e3a96cae.slice/crio-9beef2bb67da0b61460cdbb02ebef582b8ed4bc10e54ffc9697d0a7231613733 WatchSource:0}: Error finding container 9beef2bb67da0b61460cdbb02ebef582b8ed4bc10e54ffc9697d0a7231613733: Status 404 returned error can't find the container with id 9beef2bb67da0b61460cdbb02ebef582b8ed4bc10e54ffc9697d0a7231613733
Jul 09 09:34:13.288447 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:13.288365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv" event={"ID":"1ed15081-1fd1-40d8-aead-4a31e3a96cae","Type":"ContainerStarted","Data":"9beef2bb67da0b61460cdbb02ebef582b8ed4bc10e54ffc9697d0a7231613733"}
Jul 09 09:34:13.979094 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:13.979025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:34:13.979689 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:13.979668    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d46f86e-d446-465d-a65f-b2654c62dc33-service-ca-bundle\") pod \"router-default-57cd4dc8f-dv5pd\" (UID: \"8d46f86e-d446-465d-a65f-b2654c62dc33\") " pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:34:14.080306 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.080271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:34:14.082929 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.082900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/356d261a-480d-461f-8262-aff9e6e0aa15-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-27p4f\" (UID: \"356d261a-480d-461f-8262-aff9e6e0aa15\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:34:14.148943 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.148906    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-msmr4\""
Jul 09 09:34:14.156583 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.156562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:34:14.263408 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.263341    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2lxtr\""
Jul 09 09:34:14.270891 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.270869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"
Jul 09 09:34:14.414152 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.414066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f"]
Jul 09 09:34:14.416510 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:14.416471    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356d261a_480d_461f_8262_aff9e6e0aa15.slice/crio-b830db4e671eff308b5838cd0f20d5c72e75c597cf8f5f649f852f30a3a6e49e WatchSource:0}: Error finding container b830db4e671eff308b5838cd0f20d5c72e75c597cf8f5f649f852f30a3a6e49e: Status 404 returned error can't find the container with id b830db4e671eff308b5838cd0f20d5c72e75c597cf8f5f649f852f30a3a6e49e
Jul 09 09:34:14.432175 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:14.432054    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57cd4dc8f-dv5pd"]
Jul 09 09:34:14.434447 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:14.434424    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d46f86e_d446_465d_a65f_b2654c62dc33.slice/crio-1158124327a439dd8499959b15734dfbb38a000c546b02a0591962195128215c WatchSource:0}: Error finding container 1158124327a439dd8499959b15734dfbb38a000c546b02a0591962195128215c: Status 404 returned error can't find the container with id 1158124327a439dd8499959b15734dfbb38a000c546b02a0591962195128215c
Jul 09 09:34:15.297520 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:15.297482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv" event={"ID":"1ed15081-1fd1-40d8-aead-4a31e3a96cae","Type":"ContainerStarted","Data":"6438955ddb0ed7a8fe055d9c321ee71376b61f626a0c9c98e970afef884b31b1"}
Jul 09 09:34:15.298995 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:15.298967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f" event={"ID":"356d261a-480d-461f-8262-aff9e6e0aa15","Type":"ContainerStarted","Data":"b830db4e671eff308b5838cd0f20d5c72e75c597cf8f5f649f852f30a3a6e49e"}
Jul 09 09:34:15.300578 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:15.300555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd" event={"ID":"8d46f86e-d446-465d-a65f-b2654c62dc33","Type":"ContainerStarted","Data":"89719fbe09ee6feaf15080dd0db2415e5da4a5e502c624c1e4ace6236983b96d"}
Jul 09 09:34:15.300655 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:15.300596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd" event={"ID":"8d46f86e-d446-465d-a65f-b2654c62dc33","Type":"ContainerStarted","Data":"1158124327a439dd8499959b15734dfbb38a000c546b02a0591962195128215c"}
Jul 09 09:34:15.320135 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:15.320089    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vnqlv" podStartSLOduration=2.100664209 podStartE2EDuration="3.320063732s" totalImagesPullingTime="1.219399523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:15.318125197 +0000 UTC m=+90.052000876" watchObservedRunningTime="2026-07-09 09:34:15.320063732 +0000 UTC m=+90.053939414"
Jul 09 09:34:15.347751 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:15.347687    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd" podStartSLOduration=33.347665922 podStartE2EDuration="33.347665922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:15.345315291 +0000 UTC m=+90.079190976" watchObservedRunningTime="2026-07-09 09:34:15.347665922 +0000 UTC m=+90.081541606"
Jul 09 09:34:16.156731 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.156693    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:34:16.159503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.159478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:34:16.305988 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.305887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f" event={"ID":"356d261a-480d-461f-8262-aff9e6e0aa15","Type":"ContainerStarted","Data":"e664b90d33fcd5ff072e333603afa937fef68afd4603dfd92d1d3efe86502a76"}
Jul 09 09:34:16.306483 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.306311    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:34:16.307346 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.307325    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57cd4dc8f-dv5pd"
Jul 09 09:34:16.336311 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.336258    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-27p4f" podStartSLOduration=32.733092081 podStartE2EDuration="34.336242236s" totalImagesPullingTime="1.603150155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:16.335075026 +0000 UTC m=+91.068950713" watchObservedRunningTime="2026-07-09 09:34:16.336242236 +0000 UTC m=+91.070117928"
Jul 09 09:34:16.649948 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.649918    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"]
Jul 09 09:34:16.653268 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.653244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"
Jul 09 09:34:16.656207 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.656185    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lncgm\""
Jul 09 09:34:16.656637 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.656617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 09:34:16.666186 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.666166    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"]
Jul 09 09:34:16.802426 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.802390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3f2c0506-3ccd-46cf-8e5b-3c94777b752d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6czd7\" (UID: \"3f2c0506-3ccd-46cf-8e5b-3c94777b752d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"
Jul 09 09:34:16.903503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.903409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3f2c0506-3ccd-46cf-8e5b-3c94777b752d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6czd7\" (UID: \"3f2c0506-3ccd-46cf-8e5b-3c94777b752d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"
Jul 09 09:34:16.905695 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.905666    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3f2c0506-3ccd-46cf-8e5b-3c94777b752d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6czd7\" (UID: \"3f2c0506-3ccd-46cf-8e5b-3c94777b752d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"
Jul 09 09:34:16.962901 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:16.962870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"
Jul 09 09:34:17.091437 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:17.091406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"]
Jul 09 09:34:17.094229 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:17.094191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2c0506_3ccd_46cf_8e5b_3c94777b752d.slice/crio-0045fcd42579c0e2c352469d55dcba5d07252b59b08b81811afafa9de7163212 WatchSource:0}: Error finding container 0045fcd42579c0e2c352469d55dcba5d07252b59b08b81811afafa9de7163212: Status 404 returned error can't find the container with id 0045fcd42579c0e2c352469d55dcba5d07252b59b08b81811afafa9de7163212
Jul 09 09:34:17.310725 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:17.310638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7" event={"ID":"3f2c0506-3ccd-46cf-8e5b-3c94777b752d","Type":"ContainerStarted","Data":"0045fcd42579c0e2c352469d55dcba5d07252b59b08b81811afafa9de7163212"}
Jul 09 09:34:18.318432 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:18.318407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7" event={"ID":"3f2c0506-3ccd-46cf-8e5b-3c94777b752d","Type":"ContainerStarted","Data":"7fe50762a0619c524c6fbf0e31bdb8fab5508fa730da4700a2748987d65d4313"}
Jul 09 09:34:19.321905 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:19.321871    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"
Jul 09 09:34:19.326352 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:19.326329    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7"
Jul 09 09:34:19.339756 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:19.339710    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6czd7" podStartSLOduration=2.191470843 podStartE2EDuration="3.339697425s" totalImagesPullingTime="1.148226582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:19.338841525 +0000 UTC m=+94.072717221" watchObservedRunningTime="2026-07-09 09:34:19.339697425 +0000 UTC m=+94.073573108"
Jul 09 09:34:24.207145 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:24.207119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zj2qx"
Jul 09 09:34:24.972323 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:24.972282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:34:24.974622 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:24.974600    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"image-registry-6694cb7cf-6zz5n\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") " pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:34:25.073211 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.073139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:34:25.075253 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.075235    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/183388ee-280b-416c-ae5c-f22ebf11c0b0-metrics-tls\") pod \"dns-default-86td2\" (UID: \"183388ee-280b-416c-ae5c-f22ebf11c0b0\") " pod="openshift-dns/dns-default-86td2"
Jul 09 09:34:25.274669 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.274641    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-45tlw\""
Jul 09 09:34:25.282411 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.282384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:34:25.290197 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.290181    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mlrpb\""
Jul 09 09:34:25.297860 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.297841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-86td2"
Jul 09 09:34:25.434044 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.433964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6694cb7cf-6zz5n"]
Jul 09 09:34:25.438255 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:25.438226    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d16c692_0095_4628_b98a_3754b4d84ee1.slice/crio-bbff10da84205b083ca6ba31be83cd19c7334e6b5a259529ed2a1674f12bbc93 WatchSource:0}: Error finding container bbff10da84205b083ca6ba31be83cd19c7334e6b5a259529ed2a1674f12bbc93: Status 404 returned error can't find the container with id bbff10da84205b083ca6ba31be83cd19c7334e6b5a259529ed2a1674f12bbc93
Jul 09 09:34:25.451332 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:25.451311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-86td2"]
Jul 09 09:34:25.453028 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:25.453002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183388ee_280b_416c_ae5c_f22ebf11c0b0.slice/crio-bea9b7b9cd75b100a5658fc00b57798636a0d4dfbb6ee43a2ec1ad1a54050839 WatchSource:0}: Error finding container bea9b7b9cd75b100a5658fc00b57798636a0d4dfbb6ee43a2ec1ad1a54050839: Status 404 returned error can't find the container with id bea9b7b9cd75b100a5658fc00b57798636a0d4dfbb6ee43a2ec1ad1a54050839
Jul 09 09:34:26.347271 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:26.347235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n" event={"ID":"7d16c692-0095-4628-b98a-3754b4d84ee1","Type":"ContainerStarted","Data":"25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6"}
Jul 09 09:34:26.347741 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:26.347292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n" event={"ID":"7d16c692-0095-4628-b98a-3754b4d84ee1","Type":"ContainerStarted","Data":"bbff10da84205b083ca6ba31be83cd19c7334e6b5a259529ed2a1674f12bbc93"}
Jul 09 09:34:26.347741 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:26.347327    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:34:26.348612 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:26.348580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86td2" event={"ID":"183388ee-280b-416c-ae5c-f22ebf11c0b0","Type":"ContainerStarted","Data":"bea9b7b9cd75b100a5658fc00b57798636a0d4dfbb6ee43a2ec1ad1a54050839"}
Jul 09 09:34:27.354141 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:27.354110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86td2" event={"ID":"183388ee-280b-416c-ae5c-f22ebf11c0b0","Type":"ContainerStarted","Data":"cb40ffbe65f03d5b8387856f052423412173dd1abcb2c600d4a6fc7870e2968c"}
Jul 09 09:34:27.354517 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:27.354195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86td2" event={"ID":"183388ee-280b-416c-ae5c-f22ebf11c0b0","Type":"ContainerStarted","Data":"23f5a297ffeca368a5d25215a0c6870a06229607688e388aed140eed939d0fb5"}
Jul 09 09:34:27.378042 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:27.377994    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-86td2" podStartSLOduration=64.800605522 podStartE2EDuration="1m6.377980657s" totalImagesPullingTime="1.577375135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:27.376027226 +0000 UTC m=+102.109902910" watchObservedRunningTime="2026-07-09 09:34:27.377980657 +0000 UTC m=+102.111856340"
Jul 09 09:34:27.378365 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:27.378343    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n" podStartSLOduration=100.378336488 podStartE2EDuration="1m40.378336488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:26.388926187 +0000 UTC m=+101.122801871" watchObservedRunningTime="2026-07-09 09:34:27.378336488 +0000 UTC m=+102.112212171"
Jul 09 09:34:27.755346 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:27.755274    2563 scope.go:117] "RemoveContainer" containerID="b3805440b0d98f2879aff8af10474ca6c707a9a0510f3d194c12de85f5d780ee"
Jul 09 09:34:28.362019 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:28.361987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:34:28.362449 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:28.362132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" event={"ID":"8ebf28d7-9183-417d-852a-5fb7d651c0eb","Type":"ContainerStarted","Data":"41af50e395d5b931d192563bc608344f13ee06406fd4d24a4a7d98acf9a300c0"}
Jul 09 09:34:28.362449 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:28.362365    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-86td2"
Jul 09 09:34:28.388513 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:28.388466    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl" podStartSLOduration=42.760620282 podStartE2EDuration="46.388453489s" totalImagesPullingTime="3.627833207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:28.387349663 +0000 UTC m=+103.121225347" watchObservedRunningTime="2026-07-09 09:34:28.388453489 +0000 UTC m=+103.122329172"
Jul 09 09:34:29.111722 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.111694    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tmwhn"]
Jul 09 09:34:29.113983 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.113963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.117008 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.116986    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 09:34:29.117171 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.117150    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jsrjg\""
Jul 09 09:34:29.117295 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.117074    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 09:34:29.117422 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.117406    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 09:34:29.120965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.120950    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 09:34:29.203446 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-metrics-client-ca\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-accelerators-collector-config\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-textfile\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203560 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4lp\" (UniqueName: \"kubernetes.io/projected/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-kube-api-access-mz4lp\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-sys\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-wtmp\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-root\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.203720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.203663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-tls\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304112 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-tls\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304263 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-metrics-client-ca\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304263 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-accelerators-collector-config\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304263 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-textfile\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304263 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:34:29.304198    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 09:34:29.304263 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304514 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:34:29.304269    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-tls podName:6e52ae28-c9d5-4b49-960f-54f5d17d9df5 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:29.804246864 +0000 UTC m=+104.538122526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-tls") pod "node-exporter-tmwhn" (UID: "6e52ae28-c9d5-4b49-960f-54f5d17d9df5") : secret "node-exporter-tls" not found
Jul 09 09:34:29.304514 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4lp\" (UniqueName: \"kubernetes.io/projected/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-kube-api-access-mz4lp\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304514 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-sys\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304514 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304415    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-sys\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304744 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-wtmp\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304744 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-root\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304744 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-root\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304744 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304707    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-wtmp\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304914 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304809    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-textfile\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.304914 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.304834    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-accelerators-collector-config\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.305068 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.305048    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-metrics-client-ca\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.307473 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.307445    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.314492 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.314468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4lp\" (UniqueName: \"kubernetes.io/projected/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-kube-api-access-mz4lp\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.807627 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.807590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-tls\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:29.810202 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:29.810168    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e52ae28-c9d5-4b49-960f-54f5d17d9df5-node-exporter-tls\") pod \"node-exporter-tmwhn\" (UID: \"6e52ae28-c9d5-4b49-960f-54f5d17d9df5\") " pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:30.025814 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:30.025779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tmwhn"
Jul 09 09:34:30.072833 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:30.072794    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e52ae28_c9d5_4b49_960f_54f5d17d9df5.slice/crio-3ff81d317b74883b951de10802da305121fa63d6765fa1808c112a05aaea1bae WatchSource:0}: Error finding container 3ff81d317b74883b951de10802da305121fa63d6765fa1808c112a05aaea1bae: Status 404 returned error can't find the container with id 3ff81d317b74883b951de10802da305121fa63d6765fa1808c112a05aaea1bae
Jul 09 09:34:30.370452 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:30.370412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmwhn" event={"ID":"6e52ae28-c9d5-4b49-960f-54f5d17d9df5","Type":"ContainerStarted","Data":"3ff81d317b74883b951de10802da305121fa63d6765fa1808c112a05aaea1bae"}
Jul 09 09:34:32.378888 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:32.378856    2563 generic.go:356] "Generic (PLEG): container finished" podID="6e52ae28-c9d5-4b49-960f-54f5d17d9df5" containerID="a79cc16643ecb20379ee4b141e4e77da6d156817c902291ab4ab6dee6928881b" exitCode=0
Jul 09 09:34:32.379293 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:32.378899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmwhn" event={"ID":"6e52ae28-c9d5-4b49-960f-54f5d17d9df5","Type":"ContainerDied","Data":"a79cc16643ecb20379ee4b141e4e77da6d156817c902291ab4ab6dee6928881b"}
Jul 09 09:34:33.385060 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:33.385019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmwhn" event={"ID":"6e52ae28-c9d5-4b49-960f-54f5d17d9df5","Type":"ContainerStarted","Data":"46fc0b4b67264fe71fc500895c2495adbb874769978594f9c146f7e001a0e672"}
Jul 09 09:34:33.385484 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:33.385119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmwhn" event={"ID":"6e52ae28-c9d5-4b49-960f-54f5d17d9df5","Type":"ContainerStarted","Data":"af808027ba6680172c92c57aa341a431a7bd5942bb87ada7580b9e78216459cd"}
Jul 09 09:34:33.411073 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:33.411027    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tmwhn" podStartSLOduration=2.8476373219999997 podStartE2EDuration="4.411010579s" totalImagesPullingTime="1.465465917s" totalInitContainerRuntime="97.90734ms" isStatefulPod=true podCreationTimestamp="2026-07-09 09:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:33.409333051 +0000 UTC m=+108.143208735" watchObservedRunningTime="2026-07-09 09:34:33.411010579 +0000 UTC m=+108.144886262"
Jul 09 09:34:38.362592 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:38.362549    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:34:38.366677 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:38.366653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-bfvcl"
Jul 09 09:34:38.367969 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:38.367950    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-86td2"
Jul 09 09:34:40.930672 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:40.930637    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6694cb7cf-6zz5n"]
Jul 09 09:34:40.934790 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:40.934767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:34:54.702095 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:54.702043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:34:54.704369 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:54.704348    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/528db513-4644-4714-ae52-3bcdd7dc32cf-metrics-certs\") pod \"network-metrics-daemon-nwxc5\" (UID: \"528db513-4644-4714-ae52-3bcdd7dc32cf\") " pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:34:54.882697 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:54.882671    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-btgg6\""
Jul 09 09:34:54.889250 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:54.889234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwxc5"
Jul 09 09:34:55.038950 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:55.038919    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nwxc5"]
Jul 09 09:34:55.042134 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:34:55.042073    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528db513_4644_4714_ae52_3bcdd7dc32cf.slice/crio-2ba4bdc9ad16f6e03e8da77d88375dbc2f960a4bc848235993a660df9d6b2330 WatchSource:0}: Error finding container 2ba4bdc9ad16f6e03e8da77d88375dbc2f960a4bc848235993a660df9d6b2330: Status 404 returned error can't find the container with id 2ba4bdc9ad16f6e03e8da77d88375dbc2f960a4bc848235993a660df9d6b2330
Jul 09 09:34:55.461759 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:55.461723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nwxc5" event={"ID":"528db513-4644-4714-ae52-3bcdd7dc32cf","Type":"ContainerStarted","Data":"2ba4bdc9ad16f6e03e8da77d88375dbc2f960a4bc848235993a660df9d6b2330"}
Jul 09 09:34:56.466832 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:56.466786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nwxc5" event={"ID":"528db513-4644-4714-ae52-3bcdd7dc32cf","Type":"ContainerStarted","Data":"501fe3ce082105ebfd649c37bf5c976f9d1312d1f7df272d676b2cb99653c4c4"}
Jul 09 09:34:56.467205 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:56.466891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nwxc5" event={"ID":"528db513-4644-4714-ae52-3bcdd7dc32cf","Type":"ContainerStarted","Data":"c43686f121df87f00ff5c532c9adcf2e2c7d7bbcb708d374190ecd3d03bdae8f"}
Jul 09 09:34:56.491404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:34:56.491349    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nwxc5" podStartSLOduration=129.554182964 podStartE2EDuration="2m10.491328333s" totalImagesPullingTime="937.145369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:56.490885786 +0000 UTC m=+131.224761469" watchObservedRunningTime="2026-07-09 09:34:56.491328333 +0000 UTC m=+131.225204021"
Jul 09 09:35:02.491712 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:02.491677    2563 generic.go:356] "Generic (PLEG): container finished" podID="a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa" containerID="2fd06391e11e6c13b2699fb0c3db553aaeebe971146b38715878172f11ae411a" exitCode=0
Jul 09 09:35:02.492160 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:02.491717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg" event={"ID":"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa","Type":"ContainerDied","Data":"2fd06391e11e6c13b2699fb0c3db553aaeebe971146b38715878172f11ae411a"}
Jul 09 09:35:02.492160 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:02.491999    2563 scope.go:117] "RemoveContainer" containerID="2fd06391e11e6c13b2699fb0c3db553aaeebe971146b38715878172f11ae411a"
Jul 09 09:35:03.498172 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:03.498138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fcsbg" event={"ID":"a9fe8f4f-d202-4e32-b309-e3ebdcaba7fa","Type":"ContainerStarted","Data":"8987517fdbdefcbea1c0bcb3fa27ca3c062bb681929787582c8ad23178463909"}
Jul 09 09:35:05.950608 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:05.950543    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n" podUID="7d16c692-0095-4628-b98a-3754b4d84ee1" containerName="registry" containerID="cri-o://25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6" gracePeriod=30
Jul 09 09:35:06.195739 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.195712    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:35:06.291139 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291037    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291139 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291106    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-image-registry-private-configuration\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291333 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-installation-pull-secrets\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291333 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291181    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-bound-sa-token\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291333 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291206    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj2z5\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-kube-api-access-rj2z5\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291333 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291241    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-trusted-ca\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291333 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291266    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d16c692-0095-4628-b98a-3754b4d84ee1-ca-trust-extracted\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291333 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291309    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-certificates\") pod \"7d16c692-0095-4628-b98a-3754b4d84ee1\" (UID: \"7d16c692-0095-4628-b98a-3754b4d84ee1\") "
Jul 09 09:35:06.291902 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291793    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:35:06.291902 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.291828    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:35:06.293683 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.293627    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:35:06.293801 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.293710    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-kube-api-access-rj2z5" (OuterVolumeSpecName: "kube-api-access-rj2z5") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "kube-api-access-rj2z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:35:06.293801 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.293739    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:35:06.293801 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.293755    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:35:06.294016 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.293997    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:35:06.302975 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.302944    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d16c692-0095-4628-b98a-3754b4d84ee1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7d16c692-0095-4628-b98a-3754b4d84ee1" (UID: "7d16c692-0095-4628-b98a-3754b4d84ee1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:35:06.391805 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391776    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-installation-pull-secrets\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.391805 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391800    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-bound-sa-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.391805 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391809    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj2z5\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-kube-api-access-rj2z5\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.391988 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391818    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-trusted-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.391988 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391827    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d16c692-0095-4628-b98a-3754b4d84ee1-ca-trust-extracted\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.391988 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391834    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-certificates\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.391988 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391842    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d16c692-0095-4628-b98a-3754b4d84ee1-registry-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.391988 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.391851    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d16c692-0095-4628-b98a-3754b4d84ee1-image-registry-private-configuration\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:35:06.510282 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.510242    2563 generic.go:356] "Generic (PLEG): container finished" podID="7d16c692-0095-4628-b98a-3754b4d84ee1" containerID="25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6" exitCode=0
Jul 09 09:35:06.510282 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.510286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n"
Jul 09 09:35:06.510529 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.510320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n" event={"ID":"7d16c692-0095-4628-b98a-3754b4d84ee1","Type":"ContainerDied","Data":"25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6"}
Jul 09 09:35:06.510529 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.510377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6694cb7cf-6zz5n" event={"ID":"7d16c692-0095-4628-b98a-3754b4d84ee1","Type":"ContainerDied","Data":"bbff10da84205b083ca6ba31be83cd19c7334e6b5a259529ed2a1674f12bbc93"}
Jul 09 09:35:06.510529 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.510400    2563 scope.go:117] "RemoveContainer" containerID="25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6"
Jul 09 09:35:06.519468 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.519452    2563 scope.go:117] "RemoveContainer" containerID="25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6"
Jul 09 09:35:06.519710 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:35:06.519692    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6\": container with ID starting with 25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6 not found: ID does not exist" containerID="25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6"
Jul 09 09:35:06.519759 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.519718    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6"} err="failed to get container status \"25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6\": rpc error: code = NotFound desc = could not find container \"25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6\": container with ID starting with 25e4676ddc621d69e872204d097792de3fc318aedfe70a2f0093a84d9c4c27a6 not found: ID does not exist"
Jul 09 09:35:06.534344 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.534307    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6694cb7cf-6zz5n"]
Jul 09 09:35:06.538545 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:06.538524    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6694cb7cf-6zz5n"]
Jul 09 09:35:07.754763 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:07.754730    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d16c692-0095-4628-b98a-3754b4d84ee1" path="/var/lib/kubelet/pods/7d16c692-0095-4628-b98a-3754b4d84ee1/volumes"
Jul 09 09:35:22.570559 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:22.570482    2563 generic.go:356] "Generic (PLEG): container finished" podID="b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e" containerID="a07978ee2b8be17548bc223fb29d511f2bfb8b7ba9df92f592c4933a862ac874" exitCode=0
Jul 09 09:35:22.570975 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:22.570556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q" event={"ID":"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e","Type":"ContainerDied","Data":"a07978ee2b8be17548bc223fb29d511f2bfb8b7ba9df92f592c4933a862ac874"}
Jul 09 09:35:22.570975 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:22.570915    2563 scope.go:117] "RemoveContainer" containerID="a07978ee2b8be17548bc223fb29d511f2bfb8b7ba9df92f592c4933a862ac874"
Jul 09 09:35:22.572233 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:22.572214    2563 generic.go:356] "Generic (PLEG): container finished" podID="832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6" containerID="bf3fb49591dec63ed6177d3a27dfddec32cd8baaa32a4ecbae823a6469cdeabc" exitCode=0
Jul 09 09:35:22.572293 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:22.572243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq" event={"ID":"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6","Type":"ContainerDied","Data":"bf3fb49591dec63ed6177d3a27dfddec32cd8baaa32a4ecbae823a6469cdeabc"}
Jul 09 09:35:22.572512 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:22.572499    2563 scope.go:117] "RemoveContainer" containerID="bf3fb49591dec63ed6177d3a27dfddec32cd8baaa32a4ecbae823a6469cdeabc"
Jul 09 09:35:23.577820 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:23.577786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x5tvq" event={"ID":"832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6","Type":"ContainerStarted","Data":"344a619eee4d51729f94428217e64977b600513c82e68997543547472ac54519"}
Jul 09 09:35:23.579489 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:35:23.579464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jxt6q" event={"ID":"b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e","Type":"ContainerStarted","Data":"62269a220455cf7f8bb9f7e2e0c89145c6371c80550be58abb5b61f9120482e1"}
Jul 09 09:37:45.684178 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:45.684144    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:37:45.690323 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:45.690301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:37:45.693737 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:45.693714    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 09:37:55.224728 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.224693    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"]
Jul 09 09:37:55.227112 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.225121    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d16c692-0095-4628-b98a-3754b4d84ee1" containerName="registry"
Jul 09 09:37:55.227112 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.225138    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d16c692-0095-4628-b98a-3754b4d84ee1" containerName="registry"
Jul 09 09:37:55.227112 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.225220    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d16c692-0095-4628-b98a-3754b4d84ee1" containerName="registry"
Jul 09 09:37:55.227946 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.227915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.231918 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.231894    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 09:37:55.232049 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.231935    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 09:37:55.232993 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.232973    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 09:37:55.233226 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.233207    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 09:37:55.233343 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.233250    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 09:37:55.233499 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.233474    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 09:37:55.233580 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.233514    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 09:37:55.245228 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.245208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"]
Jul 09 09:37:55.315157 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.315134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-hub\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.315267 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.315178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-ca\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.315267 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.315211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.315267 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.315233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.315267 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.315252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wv8t\" (UniqueName: \"kubernetes.io/projected/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-kube-api-access-6wv8t\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.315404 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.315280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.416496 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.416465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.416597 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.416503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.416597 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.416526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wv8t\" (UniqueName: \"kubernetes.io/projected/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-kube-api-access-6wv8t\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.416597 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.416561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.416597 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.416578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-hub\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.416792 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.416612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-ca\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.417331 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.417305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.419055 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.419028    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-hub\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.419184 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.419115    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-ca\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.419184 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.419166    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.419298 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.419217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.425581 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.425555    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wv8t\" (UniqueName: \"kubernetes.io/projected/1a49bae2-2ff0-401d-902c-4c5f3a9f836a-kube-api-access-6wv8t\") pod \"cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq\" (UID: \"1a49bae2-2ff0-401d-902c-4c5f3a9f836a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.543641 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.543572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"
Jul 09 09:37:55.667995 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.667956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq"]
Jul 09 09:37:55.670295 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:37:55.670268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a49bae2_2ff0_401d_902c_4c5f3a9f836a.slice/crio-0351114b596bf503e3ef52dcd602f4aa36499e5c36ade22a5ba92949a0742f86 WatchSource:0}: Error finding container 0351114b596bf503e3ef52dcd602f4aa36499e5c36ade22a5ba92949a0742f86: Status 404 returned error can't find the container with id 0351114b596bf503e3ef52dcd602f4aa36499e5c36ade22a5ba92949a0742f86
Jul 09 09:37:55.672043 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:55.672022    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 09:37:56.131064 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:37:56.131021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq" event={"ID":"1a49bae2-2ff0-401d-902c-4c5f3a9f836a","Type":"ContainerStarted","Data":"0351114b596bf503e3ef52dcd602f4aa36499e5c36ade22a5ba92949a0742f86"}
Jul 09 09:38:00.149822 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:38:00.149783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq" event={"ID":"1a49bae2-2ff0-401d-902c-4c5f3a9f836a","Type":"ContainerStarted","Data":"85e18987e337d3e8517161420b554ed3ee4e9a52665359cdbc39c6a3afbd4a1c"}
Jul 09 09:38:00.150329 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:38:00.149837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq" event={"ID":"1a49bae2-2ff0-401d-902c-4c5f3a9f836a","Type":"ContainerStarted","Data":"108bf68213ee985c6dbf4c214e8f5fb83dad724aab4910800fa14acf970b25d5"}
Jul 09 09:38:00.150329 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:38:00.149853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq" event={"ID":"1a49bae2-2ff0-401d-902c-4c5f3a9f836a","Type":"ContainerStarted","Data":"5bcb0b95e737a98f454771390e04b2a0b23cfb1a94ee61b1e89efc24b1effbbd"}
Jul 09 09:38:00.171740 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:38:00.171686    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f95b5bd8f-2f4tq" podStartSLOduration=1.709984173 podStartE2EDuration="5.171672756s" totalImagesPullingTime="3.461688583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:38:00.170050571 +0000 UTC m=+314.903926269" watchObservedRunningTime="2026-07-09 09:38:00.171672756 +0000 UTC m=+314.905548438"
Jul 09 09:42:45.708937 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:42:45.708911    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:42:45.713362 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:42:45.713340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:43:18.455663 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.455566    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"]
Jul 09 09:43:18.459010 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.458994    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.461947 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.461924    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1980c-kube-rbac-proxy-sar-config\""
Jul 09 09:43:18.462110 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.461939    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1980c-predictor-serving-cert\""
Jul 09 09:43:18.462110 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.461946    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 09:43:18.462110 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.461993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-tmt4d\""
Jul 09 09:43:18.463182 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.463165    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 09:43:18.471206 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.471181    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"]
Jul 09 09:43:18.592670 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.592635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwd5f\" (UniqueName: \"kubernetes.io/projected/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-api-access-cwd5f\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.592847 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.592678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.592847 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.592697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.694167 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.694136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwd5f\" (UniqueName: \"kubernetes.io/projected/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-api-access-cwd5f\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.694358 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.694324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.694425 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.694359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.694552 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:43:18.694526    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-1980c-predictor-serving-cert: secret "success-200-isvc-1980c-predictor-serving-cert" not found
Jul 09 09:43:18.694632 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:43:18.694608    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls podName:852da3a5-11db-4411-8a3f-b1a16c31d218 nodeName:}" failed. No retries permitted until 2026-07-09 09:43:19.194586842 +0000 UTC m=+633.928462510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls") pod "success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" (UID: "852da3a5-11db-4411-8a3f-b1a16c31d218") : secret "success-200-isvc-1980c-predictor-serving-cert" not found
Jul 09 09:43:18.695222 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.695200    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:18.716003 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:18.715938    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwd5f\" (UniqueName: \"kubernetes.io/projected/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-api-access-cwd5f\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:19.199797 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:19.199762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:19.202160 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:19.202139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls\") pod \"success-200-isvc-1980c-predictor-8479bf99dd-f2xcf\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") " pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:19.371845 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:19.371806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:19.501257 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:19.501214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"]
Jul 09 09:43:19.504351 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:43:19.504325    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852da3a5_11db_4411_8a3f_b1a16c31d218.slice/crio-5e257deed2f27c280a7e67cd9129009782915a6d0deb5a41ac82c8efc9cc1747 WatchSource:0}: Error finding container 5e257deed2f27c280a7e67cd9129009782915a6d0deb5a41ac82c8efc9cc1747: Status 404 returned error can't find the container with id 5e257deed2f27c280a7e67cd9129009782915a6d0deb5a41ac82c8efc9cc1747
Jul 09 09:43:19.506309 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:19.506293    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 09:43:20.319997 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:20.319957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" event={"ID":"852da3a5-11db-4411-8a3f-b1a16c31d218","Type":"ContainerStarted","Data":"5e257deed2f27c280a7e67cd9129009782915a6d0deb5a41ac82c8efc9cc1747"}
Jul 09 09:43:33.379515 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:33.379476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" event={"ID":"852da3a5-11db-4411-8a3f-b1a16c31d218","Type":"ContainerStarted","Data":"ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d"}
Jul 09 09:43:35.389469 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:35.389429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" event={"ID":"852da3a5-11db-4411-8a3f-b1a16c31d218","Type":"ContainerStarted","Data":"4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f"}
Jul 09 09:43:35.389986 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:35.389507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:35.389986 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:35.389536    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:35.391020 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:35.390987    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 09 09:43:35.413357 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:35.413304    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podStartSLOduration=2.097546185 podStartE2EDuration="17.413284638s" totalImagesPullingTime="15.315738453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:43:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:43:35.412572127 +0000 UTC m=+650.146447806" watchObservedRunningTime="2026-07-09 09:43:35.413284638 +0000 UTC m=+650.147160324"
Jul 09 09:43:36.393802 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:36.393756    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 09 09:43:41.398954 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:41.398921    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:43:41.399413 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:41.399385    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 09 09:43:51.400137 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:43:51.400073    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 09 09:44:01.400359 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:01.400317    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 09 09:44:11.400315 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:11.400275    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 09 09:44:21.400275 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:21.400242    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:44:52.526473 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.526437    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"]
Jul 09 09:44:52.527026 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.526755    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container" containerID="cri-o://ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d" gracePeriod=30
Jul 09 09:44:52.527026 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.526804    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kube-rbac-proxy" containerID="cri-o://4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f" gracePeriod=30
Jul 09 09:44:52.579541 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.579512    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"]
Jul 09 09:44:52.582186 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.582172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.584640 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.584617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8d1ee-predictor-serving-cert\""
Jul 09 09:44:52.584765 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.584716    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8d1ee-kube-rbac-proxy-sar-config\""
Jul 09 09:44:52.595575 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.595546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"]
Jul 09 09:44:52.652195 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.652164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.652334 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.652201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5qkd\" (UniqueName: \"kubernetes.io/projected/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-api-access-m5qkd\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.652334 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.652240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.691927 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.691890    2563 generic.go:356] "Generic (PLEG): container finished" podID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerID="4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f" exitCode=2
Jul 09 09:44:52.692074 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.691956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" event={"ID":"852da3a5-11db-4411-8a3f-b1a16c31d218","Type":"ContainerDied","Data":"4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f"}
Jul 09 09:44:52.753253 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.753219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.753453 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.753258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5qkd\" (UniqueName: \"kubernetes.io/projected/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-api-access-m5qkd\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.753453 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.753414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.753620 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:44:52.753600    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-serving-cert: secret "success-200-isvc-8d1ee-predictor-serving-cert" not found
Jul 09 09:44:52.753680 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:44:52.753670    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls podName:b3410a92-3fb5-47bd-885b-6831cb0b2523 nodeName:}" failed. No retries permitted until 2026-07-09 09:44:53.253653445 +0000 UTC m=+727.987529106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls") pod "success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" (UID: "b3410a92-3fb5-47bd-885b-6831cb0b2523") : secret "success-200-isvc-8d1ee-predictor-serving-cert" not found
Jul 09 09:44:52.754167 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.754146    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:52.765194 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:52.765161    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5qkd\" (UniqueName: \"kubernetes.io/projected/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-api-access-m5qkd\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:53.257011 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:53.256977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:53.259397 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:53.259366    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls\") pod \"success-200-isvc-8d1ee-predictor-76fdc6df88-526xq\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") " pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:53.494210 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:53.494175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:53.625867 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:53.625807    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"]
Jul 09 09:44:53.628351 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:44:53.628324    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3410a92_3fb5_47bd_885b_6831cb0b2523.slice/crio-5dcd67b3c4bcfba658851d201f238f206424fe3d8a228a85b2c9e5c5d9418db3 WatchSource:0}: Error finding container 5dcd67b3c4bcfba658851d201f238f206424fe3d8a228a85b2c9e5c5d9418db3: Status 404 returned error can't find the container with id 5dcd67b3c4bcfba658851d201f238f206424fe3d8a228a85b2c9e5c5d9418db3
Jul 09 09:44:53.697417 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:53.697388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" event={"ID":"b3410a92-3fb5-47bd-885b-6831cb0b2523","Type":"ContainerStarted","Data":"1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e"}
Jul 09 09:44:53.697513 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:53.697447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" event={"ID":"b3410a92-3fb5-47bd-885b-6831cb0b2523","Type":"ContainerStarted","Data":"5dcd67b3c4bcfba658851d201f238f206424fe3d8a228a85b2c9e5c5d9418db3"}
Jul 09 09:44:54.703929 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:54.703892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" event={"ID":"b3410a92-3fb5-47bd-885b-6831cb0b2523","Type":"ContainerStarted","Data":"cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1"}
Jul 09 09:44:54.704364 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:54.703991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:54.721894 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:54.721847    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podStartSLOduration=2.721828974 podStartE2EDuration="2.721828974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:44:54.721224787 +0000 UTC m=+729.455100470" watchObservedRunningTime="2026-07-09 09:44:54.721828974 +0000 UTC m=+729.455704656"
Jul 09 09:44:55.675500 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.675477    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:44:55.710141 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.710110    2563 generic.go:356] "Generic (PLEG): container finished" podID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerID="ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d" exitCode=0
Jul 09 09:44:55.710553 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.710222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" event={"ID":"852da3a5-11db-4411-8a3f-b1a16c31d218","Type":"ContainerDied","Data":"ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d"}
Jul 09 09:44:55.710553 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.710300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf" event={"ID":"852da3a5-11db-4411-8a3f-b1a16c31d218","Type":"ContainerDied","Data":"5e257deed2f27c280a7e67cd9129009782915a6d0deb5a41ac82c8efc9cc1747"}
Jul 09 09:44:55.710553 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.710353    2563 scope.go:117] "RemoveContainer" containerID="4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f"
Jul 09 09:44:55.710553 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.710485    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"
Jul 09 09:44:55.710553 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.710503    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:44:55.711830 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.711807    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 09 09:44:55.719972 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.719954    2563 scope.go:117] "RemoveContainer" containerID="ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d"
Jul 09 09:44:55.727366 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.727347    2563 scope.go:117] "RemoveContainer" containerID="4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f"
Jul 09 09:44:55.727628 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:44:55.727612    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f\": container with ID starting with 4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f not found: ID does not exist" containerID="4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f"
Jul 09 09:44:55.727700 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.727636    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f"} err="failed to get container status \"4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f\": rpc error: code = NotFound desc = could not find container \"4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f\": container with ID starting with 4e6d1ebba31c344ed32a49e1e5475537426bc4d7d9fd9446ad22c7b9a6252f6f not found: ID does not exist"
Jul 09 09:44:55.727700 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.727653    2563 scope.go:117] "RemoveContainer" containerID="ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d"
Jul 09 09:44:55.727877 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:44:55.727862    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d\": container with ID starting with ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d not found: ID does not exist" containerID="ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d"
Jul 09 09:44:55.727916 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.727881    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d"} err="failed to get container status \"ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d\": rpc error: code = NotFound desc = could not find container \"ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d\": container with ID starting with ff93a3a807b912119fdd613919aa36289ddc5163efd0a4bb4217357dc857518d not found: ID does not exist"
Jul 09 09:44:55.776857 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.776784    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwd5f\" (UniqueName: \"kubernetes.io/projected/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-api-access-cwd5f\") pod \"852da3a5-11db-4411-8a3f-b1a16c31d218\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") "
Jul 09 09:44:55.776857 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.776822    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-rbac-proxy-sar-config\") pod \"852da3a5-11db-4411-8a3f-b1a16c31d218\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") "
Jul 09 09:44:55.776857 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.776847    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls\") pod \"852da3a5-11db-4411-8a3f-b1a16c31d218\" (UID: \"852da3a5-11db-4411-8a3f-b1a16c31d218\") "
Jul 09 09:44:55.777201 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.777171    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "852da3a5-11db-4411-8a3f-b1a16c31d218" (UID: "852da3a5-11db-4411-8a3f-b1a16c31d218"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:44:55.777274 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.777247    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:44:55.779108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.779059    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-api-access-cwd5f" (OuterVolumeSpecName: "kube-api-access-cwd5f") pod "852da3a5-11db-4411-8a3f-b1a16c31d218" (UID: "852da3a5-11db-4411-8a3f-b1a16c31d218"). InnerVolumeSpecName "kube-api-access-cwd5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:44:55.779108 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.779058    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "852da3a5-11db-4411-8a3f-b1a16c31d218" (UID: "852da3a5-11db-4411-8a3f-b1a16c31d218"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:44:55.878256 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.878220    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwd5f\" (UniqueName: \"kubernetes.io/projected/852da3a5-11db-4411-8a3f-b1a16c31d218-kube-api-access-cwd5f\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:44:55.878256 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:55.878250    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/852da3a5-11db-4411-8a3f-b1a16c31d218-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:44:56.034355 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:56.034285    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"]
Jul 09 09:44:56.041472 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:56.041447    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1980c-predictor-8479bf99dd-f2xcf"]
Jul 09 09:44:56.715540 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:56.715502    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 09 09:44:57.754903 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:44:57.754868    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" path="/var/lib/kubelet/pods/852da3a5-11db-4411-8a3f-b1a16c31d218/volumes"
Jul 09 09:45:01.720349 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:01.720312    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:45:01.720875 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:01.720847    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 09 09:45:11.721559 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:11.721519    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 09 09:45:21.721675 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:21.721633    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 09 09:45:31.721773 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:31.721678    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 09 09:45:41.722219 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:41.722188    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:45:48.535659 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.531949    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"]
Jul 09 09:45:48.535659 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.532614    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kube-rbac-proxy"
Jul 09 09:45:48.535659 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.532633    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kube-rbac-proxy"
Jul 09 09:45:48.535659 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.532693    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container"
Jul 09 09:45:48.535659 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.532701    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container"
Jul 09 09:45:48.535659 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.532824    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kube-rbac-proxy"
Jul 09 09:45:48.535659 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.532845    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="852da3a5-11db-4411-8a3f-b1a16c31d218" containerName="kserve-container"
Jul 09 09:45:48.538055 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.538031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.540936 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.540917    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8b307-kube-rbac-proxy-sar-config\""
Jul 09 09:45:48.541030 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.540919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8b307-predictor-serving-cert\""
Jul 09 09:45:48.544189 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.544163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"]
Jul 09 09:45:48.619602 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.619568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.619778 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.619612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.619778 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.619712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z8xh\" (UniqueName: \"kubernetes.io/projected/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-api-access-8z8xh\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.721140 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.721098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.721332 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:45:48.721241    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-8b307-predictor-serving-cert: secret "success-200-isvc-8b307-predictor-serving-cert" not found
Jul 09 09:45:48.721332 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:45:48.721325    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls podName:5bec4f26-b047-49c6-9a6d-71c427f0b25b nodeName:}" failed. No retries permitted until 2026-07-09 09:45:49.221304687 +0000 UTC m=+783.955180359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls") pod "success-200-isvc-8b307-predictor-94cb94958-qkdf6" (UID: "5bec4f26-b047-49c6-9a6d-71c427f0b25b") : secret "success-200-isvc-8b307-predictor-serving-cert" not found
Jul 09 09:45:48.721450 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.721238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.721503 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.721455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z8xh\" (UniqueName: \"kubernetes.io/projected/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-api-access-8z8xh\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.721835 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.721817    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:48.732466 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:48.732437    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z8xh\" (UniqueName: \"kubernetes.io/projected/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-api-access-8z8xh\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:49.225252 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.225218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:49.227636 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.227617    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls\") pod \"success-200-isvc-8b307-predictor-94cb94958-qkdf6\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") " pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:49.449500 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.449457    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:49.577885 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.577860    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"]
Jul 09 09:45:49.580274 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:45:49.580246    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bec4f26_b047_49c6_9a6d_71c427f0b25b.slice/crio-cc1bfeafc302fa8ac64cb568d5b17f563507e67a10f048372e9ef46671e6b73f WatchSource:0}: Error finding container cc1bfeafc302fa8ac64cb568d5b17f563507e67a10f048372e9ef46671e6b73f: Status 404 returned error can't find the container with id cc1bfeafc302fa8ac64cb568d5b17f563507e67a10f048372e9ef46671e6b73f
Jul 09 09:45:49.932095 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.932051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" event={"ID":"5bec4f26-b047-49c6-9a6d-71c427f0b25b","Type":"ContainerStarted","Data":"02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb"}
Jul 09 09:45:49.932263 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.932139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" event={"ID":"5bec4f26-b047-49c6-9a6d-71c427f0b25b","Type":"ContainerStarted","Data":"6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027"}
Jul 09 09:45:49.932263 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.932167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" event={"ID":"5bec4f26-b047-49c6-9a6d-71c427f0b25b","Type":"ContainerStarted","Data":"cc1bfeafc302fa8ac64cb568d5b17f563507e67a10f048372e9ef46671e6b73f"}
Jul 09 09:45:49.932263 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.932194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:49.951224 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:49.951175    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podStartSLOduration=1.951159961 podStartE2EDuration="1.951159961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:45:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:45:49.949855128 +0000 UTC m=+784.683730812" watchObservedRunningTime="2026-07-09 09:45:49.951159961 +0000 UTC m=+784.685035683"
Jul 09 09:45:50.935888 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:50.935859    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:50.937140 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:50.937112    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 09 09:45:51.939949 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:51.939910    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 09 09:45:56.945188 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:56.945158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:45:56.945682 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:45:56.945614    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 09 09:46:06.945904 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:46:06.945861    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 09 09:46:16.945822 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:46:16.945734    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 09 09:46:26.946242 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:46:26.946193    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 09 09:46:36.947037 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:46:36.947002    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:47:45.733868 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:47:45.733837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:47:45.736195 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:47:45.736175    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:52:45.770116 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:52:45.770069    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:52:45.770642 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:52:45.770271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:54:07.346359 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.346325    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"]
Jul 09 09:54:07.346943 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.346667    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container" containerID="cri-o://1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e" gracePeriod=30
Jul 09 09:54:07.346943 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.346690    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kube-rbac-proxy" containerID="cri-o://cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1" gracePeriod=30
Jul 09 09:54:07.410685 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.410653    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"]
Jul 09 09:54:07.414090 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.414061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.416994 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.416972    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-b04db-predictor-serving-cert\""
Jul 09 09:54:07.417119 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.417053    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-b04db-kube-rbac-proxy-sar-config\""
Jul 09 09:54:07.429615 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.429584    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"]
Jul 09 09:54:07.489680 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.489647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.489860 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.489689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dxn9\" (UniqueName: \"kubernetes.io/projected/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-api-access-5dxn9\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.489860 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.489794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.590430 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.590392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.590614 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.590439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dxn9\" (UniqueName: \"kubernetes.io/projected/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-api-access-5dxn9\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.590614 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.590474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.590614 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:54:07.590584    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-b04db-predictor-serving-cert: secret "success-200-isvc-b04db-predictor-serving-cert" not found
Jul 09 09:54:07.590732 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:54:07.590652    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls podName:ee03df07-0340-4983-b3e2-b5e90c60705e nodeName:}" failed. No retries permitted until 2026-07-09 09:54:08.090635307 +0000 UTC m=+1282.824510967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls") pod "success-200-isvc-b04db-predictor-869d74887d-c7bcl" (UID: "ee03df07-0340-4983-b3e2-b5e90c60705e") : secret "success-200-isvc-b04db-predictor-serving-cert" not found
Jul 09 09:54:07.591191 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.591173    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.600952 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.600876    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dxn9\" (UniqueName: \"kubernetes.io/projected/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-api-access-5dxn9\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:07.836717 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.836681    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerID="cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1" exitCode=2
Jul 09 09:54:07.836717 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:07.836720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" event={"ID":"b3410a92-3fb5-47bd-885b-6831cb0b2523","Type":"ContainerDied","Data":"cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1"}
Jul 09 09:54:08.094616 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:08.094580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:08.094805 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:54:08.094725    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-b04db-predictor-serving-cert: secret "success-200-isvc-b04db-predictor-serving-cert" not found
Jul 09 09:54:08.094805 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:54:08.094793    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls podName:ee03df07-0340-4983-b3e2-b5e90c60705e nodeName:}" failed. No retries permitted until 2026-07-09 09:54:09.094778395 +0000 UTC m=+1283.828654060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls") pod "success-200-isvc-b04db-predictor-869d74887d-c7bcl" (UID: "ee03df07-0340-4983-b3e2-b5e90c60705e") : secret "success-200-isvc-b04db-predictor-serving-cert" not found
Jul 09 09:54:09.102499 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.102446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:09.104914 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.104893    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls\") pod \"success-200-isvc-b04db-predictor-869d74887d-c7bcl\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") " pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:09.225686 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.225650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:09.363860 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.363833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"]
Jul 09 09:54:09.366453 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:54:09.366424    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee03df07_0340_4983_b3e2_b5e90c60705e.slice/crio-9b44280ec48603f952b40bf89cf0bc473f635cf4aa103c78741a567e47d69aa7 WatchSource:0}: Error finding container 9b44280ec48603f952b40bf89cf0bc473f635cf4aa103c78741a567e47d69aa7: Status 404 returned error can't find the container with id 9b44280ec48603f952b40bf89cf0bc473f635cf4aa103c78741a567e47d69aa7
Jul 09 09:54:09.852572 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.852536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" event={"ID":"ee03df07-0340-4983-b3e2-b5e90c60705e","Type":"ContainerStarted","Data":"5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a"}
Jul 09 09:54:09.852781 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.852617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" event={"ID":"ee03df07-0340-4983-b3e2-b5e90c60705e","Type":"ContainerStarted","Data":"2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b"}
Jul 09 09:54:09.852781 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.852637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" event={"ID":"ee03df07-0340-4983-b3e2-b5e90c60705e","Type":"ContainerStarted","Data":"9b44280ec48603f952b40bf89cf0bc473f635cf4aa103c78741a567e47d69aa7"}
Jul 09 09:54:09.852781 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.852679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:09.852781 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.852717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:09.853986 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.853961    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 09 09:54:09.873909 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:09.873862    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podStartSLOduration=2.873848722 podStartE2EDuration="2.873848722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:54:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:54:09.871854061 +0000 UTC m=+1284.605729746" watchObservedRunningTime="2026-07-09 09:54:09.873848722 +0000 UTC m=+1284.607724404"
Jul 09 09:54:10.597212 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.597186    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:54:10.716691 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.716602    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5qkd\" (UniqueName: \"kubernetes.io/projected/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-api-access-m5qkd\") pod \"b3410a92-3fb5-47bd-885b-6831cb0b2523\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") "
Jul 09 09:54:10.716691 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.716639    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls\") pod \"b3410a92-3fb5-47bd-885b-6831cb0b2523\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") "
Jul 09 09:54:10.716691 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.716675    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-rbac-proxy-sar-config\") pod \"b3410a92-3fb5-47bd-885b-6831cb0b2523\" (UID: \"b3410a92-3fb5-47bd-885b-6831cb0b2523\") "
Jul 09 09:54:10.717066 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.717042    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b3410a92-3fb5-47bd-885b-6831cb0b2523" (UID: "b3410a92-3fb5-47bd-885b-6831cb0b2523"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:54:10.718809 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.718775    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-api-access-m5qkd" (OuterVolumeSpecName: "kube-api-access-m5qkd") pod "b3410a92-3fb5-47bd-885b-6831cb0b2523" (UID: "b3410a92-3fb5-47bd-885b-6831cb0b2523"). InnerVolumeSpecName "kube-api-access-m5qkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:54:10.718917 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.718851    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b3410a92-3fb5-47bd-885b-6831cb0b2523" (UID: "b3410a92-3fb5-47bd-885b-6831cb0b2523"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:54:10.817279 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.817245    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:54:10.817279 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.817273    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5qkd\" (UniqueName: \"kubernetes.io/projected/b3410a92-3fb5-47bd-885b-6831cb0b2523-kube-api-access-m5qkd\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:54:10.817279 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.817283    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b3410a92-3fb5-47bd-885b-6831cb0b2523-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:54:10.858155 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.858123    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerID="1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e" exitCode=0
Jul 09 09:54:10.858337 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.858181    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"
Jul 09 09:54:10.858337 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.858211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" event={"ID":"b3410a92-3fb5-47bd-885b-6831cb0b2523","Type":"ContainerDied","Data":"1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e"}
Jul 09 09:54:10.858337 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.858266    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq" event={"ID":"b3410a92-3fb5-47bd-885b-6831cb0b2523","Type":"ContainerDied","Data":"5dcd67b3c4bcfba658851d201f238f206424fe3d8a228a85b2c9e5c5d9418db3"}
Jul 09 09:54:10.858337 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.858292    2563 scope.go:117] "RemoveContainer" containerID="cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1"
Jul 09 09:54:10.858876 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.858831    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 09 09:54:10.866715 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.866699    2563 scope.go:117] "RemoveContainer" containerID="1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e"
Jul 09 09:54:10.874454 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.874437    2563 scope.go:117] "RemoveContainer" containerID="cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1"
Jul 09 09:54:10.874706 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:54:10.874689    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1\": container with ID starting with cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1 not found: ID does not exist" containerID="cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1"
Jul 09 09:54:10.874780 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.874712    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1"} err="failed to get container status \"cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1\": rpc error: code = NotFound desc = could not find container \"cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1\": container with ID starting with cdf95ae7825940df4489360eece5cb17e63f8f6e988cfe951ec2c64e41fcb8f1 not found: ID does not exist"
Jul 09 09:54:10.874780 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.874726    2563 scope.go:117] "RemoveContainer" containerID="1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e"
Jul 09 09:54:10.874914 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:54:10.874897    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e\": container with ID starting with 1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e not found: ID does not exist" containerID="1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e"
Jul 09 09:54:10.874951 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.874917    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e"} err="failed to get container status \"1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e\": rpc error: code = NotFound desc = could not find container \"1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e\": container with ID starting with 1fedd169019cfe6c90b1f716d28d57f1e0c7cd6a63d6babf38dd0f1cda6c2b5e not found: ID does not exist"
Jul 09 09:54:10.880698 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.880673    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"]
Jul 09 09:54:10.884782 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:10.884759    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8d1ee-predictor-76fdc6df88-526xq"]
Jul 09 09:54:11.756435 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:11.756396    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" path="/var/lib/kubelet/pods/b3410a92-3fb5-47bd-885b-6831cb0b2523/volumes"
Jul 09 09:54:15.863633 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:15.863606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:54:15.864145 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:15.864052    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 09 09:54:25.864420 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:25.864382    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 09 09:54:35.864887 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:35.864840    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 09 09:54:45.865054 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:45.865009    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 09 09:54:55.865513 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:54:55.865484    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:55:03.245226 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.245185    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"]
Jul 09 09:55:03.245679 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.245425    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container" containerID="cri-o://6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027" gracePeriod=30
Jul 09 09:55:03.245679 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.245488    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kube-rbac-proxy" containerID="cri-o://02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb" gracePeriod=30
Jul 09 09:55:03.313426 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.313393    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"]
Jul 09 09:55:03.314933 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.314256    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kube-rbac-proxy"
Jul 09 09:55:03.316491 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.315207    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kube-rbac-proxy"
Jul 09 09:55:03.316491 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.315329    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container"
Jul 09 09:55:03.316491 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.315339    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container"
Jul 09 09:55:03.316491 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.315596    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kserve-container"
Jul 09 09:55:03.316491 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.315614    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3410a92-3fb5-47bd-885b-6831cb0b2523" containerName="kube-rbac-proxy"
Jul 09 09:55:03.319713 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.319692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.322510 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.322488    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a3d13-kube-rbac-proxy-sar-config\""
Jul 09 09:55:03.322648 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.322510    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a3d13-predictor-serving-cert\""
Jul 09 09:55:03.327255 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.327037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"]
Jul 09 09:55:03.434323 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.434295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5052dea4-f5e4-4694-8416-126e739b6641-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.434471 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.434336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlh7k\" (UniqueName: \"kubernetes.io/projected/5052dea4-f5e4-4694-8416-126e739b6641-kube-api-access-dlh7k\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.434471 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.434368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.535416 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.535345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5052dea4-f5e4-4694-8416-126e739b6641-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.535416 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.535382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlh7k\" (UniqueName: \"kubernetes.io/projected/5052dea4-f5e4-4694-8416-126e739b6641-kube-api-access-dlh7k\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.535416 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.535411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.535658 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:03.535544    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-serving-cert: secret "success-200-isvc-a3d13-predictor-serving-cert" not found
Jul 09 09:55:03.535658 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:03.535614    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls podName:5052dea4-f5e4-4694-8416-126e739b6641 nodeName:}" failed. No retries permitted until 2026-07-09 09:55:04.035595133 +0000 UTC m=+1338.769470795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls") pod "success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" (UID: "5052dea4-f5e4-4694-8416-126e739b6641") : secret "success-200-isvc-a3d13-predictor-serving-cert" not found
Jul 09 09:55:03.536141 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.536120    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5052dea4-f5e4-4694-8416-126e739b6641-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:03.544295 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:03.544267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlh7k\" (UniqueName: \"kubernetes.io/projected/5052dea4-f5e4-4694-8416-126e739b6641-kube-api-access-dlh7k\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:04.038583 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:04.038551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:04.040870 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:04.040847    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls\") pod \"success-200-isvc-a3d13-predictor-8b899dc74-hvw4g\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") " pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:04.071854 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:04.071826    2563 generic.go:356] "Generic (PLEG): container finished" podID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerID="02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb" exitCode=2
Jul 09 09:55:04.071986 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:04.071877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" event={"ID":"5bec4f26-b047-49c6-9a6d-71c427f0b25b","Type":"ContainerDied","Data":"02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb"}
Jul 09 09:55:04.230682 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:04.230654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:04.360318 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:04.360268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"]
Jul 09 09:55:04.362697 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:55:04.362671    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5052dea4_f5e4_4694_8416_126e739b6641.slice/crio-384346c7ee867dd599c792ae9bf2d70ef2b347a76ba46c7a90f08d7425374ce5 WatchSource:0}: Error finding container 384346c7ee867dd599c792ae9bf2d70ef2b347a76ba46c7a90f08d7425374ce5: Status 404 returned error can't find the container with id 384346c7ee867dd599c792ae9bf2d70ef2b347a76ba46c7a90f08d7425374ce5
Jul 09 09:55:05.077716 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:05.077678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" event={"ID":"5052dea4-f5e4-4694-8416-126e739b6641","Type":"ContainerStarted","Data":"bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40"}
Jul 09 09:55:05.077895 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:05.077733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" event={"ID":"5052dea4-f5e4-4694-8416-126e739b6641","Type":"ContainerStarted","Data":"f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624"}
Jul 09 09:55:05.077895 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:05.077757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" event={"ID":"5052dea4-f5e4-4694-8416-126e739b6641","Type":"ContainerStarted","Data":"384346c7ee867dd599c792ae9bf2d70ef2b347a76ba46c7a90f08d7425374ce5"}
Jul 09 09:55:05.077895 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:05.077784    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:05.077895 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:05.077805    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:05.079230 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:05.079207    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 09 09:55:05.098618 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:05.098574    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podStartSLOduration=2.098559142 podStartE2EDuration="2.098559142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:55:05.096026042 +0000 UTC m=+1339.829901725" watchObservedRunningTime="2026-07-09 09:55:05.098559142 +0000 UTC m=+1339.832434824"
Jul 09 09:55:06.081940 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.081904    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 09 09:55:06.393979 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.393956    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:55:06.458802 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.458773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z8xh\" (UniqueName: \"kubernetes.io/projected/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-api-access-8z8xh\") pod \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") "
Jul 09 09:55:06.458955 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.458818    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-rbac-proxy-sar-config\") pod \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") "
Jul 09 09:55:06.458955 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.458894    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls\") pod \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\" (UID: \"5bec4f26-b047-49c6-9a6d-71c427f0b25b\") "
Jul 09 09:55:06.459248 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.459218    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5bec4f26-b047-49c6-9a6d-71c427f0b25b" (UID: "5bec4f26-b047-49c6-9a6d-71c427f0b25b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:55:06.460861 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.460839    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5bec4f26-b047-49c6-9a6d-71c427f0b25b" (UID: "5bec4f26-b047-49c6-9a6d-71c427f0b25b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:55:06.460948 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.460841    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-api-access-8z8xh" (OuterVolumeSpecName: "kube-api-access-8z8xh") pod "5bec4f26-b047-49c6-9a6d-71c427f0b25b" (UID: "5bec4f26-b047-49c6-9a6d-71c427f0b25b"). InnerVolumeSpecName "kube-api-access-8z8xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:55:06.560027 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.559992    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5bec4f26-b047-49c6-9a6d-71c427f0b25b-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:55:06.560027 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.560020    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z8xh\" (UniqueName: \"kubernetes.io/projected/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-api-access-8z8xh\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:55:06.560027 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:06.560030    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5bec4f26-b047-49c6-9a6d-71c427f0b25b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:55:07.087004 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.086972    2563 generic.go:356] "Generic (PLEG): container finished" podID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerID="6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027" exitCode=0
Jul 09 09:55:07.087416 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.087021    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"
Jul 09 09:55:07.087416 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.087045    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" event={"ID":"5bec4f26-b047-49c6-9a6d-71c427f0b25b","Type":"ContainerDied","Data":"6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027"}
Jul 09 09:55:07.087416 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.087113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6" event={"ID":"5bec4f26-b047-49c6-9a6d-71c427f0b25b","Type":"ContainerDied","Data":"cc1bfeafc302fa8ac64cb568d5b17f563507e67a10f048372e9ef46671e6b73f"}
Jul 09 09:55:07.087416 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.087139    2563 scope.go:117] "RemoveContainer" containerID="02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb"
Jul 09 09:55:07.095885 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.095869    2563 scope.go:117] "RemoveContainer" containerID="6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027"
Jul 09 09:55:07.103012 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.102997    2563 scope.go:117] "RemoveContainer" containerID="02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb"
Jul 09 09:55:07.103291 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:07.103273    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb\": container with ID starting with 02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb not found: ID does not exist" containerID="02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb"
Jul 09 09:55:07.103355 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.103300    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb"} err="failed to get container status \"02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb\": rpc error: code = NotFound desc = could not find container \"02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb\": container with ID starting with 02403783de7e6002f3aa083fa7c5929ef381f09234e637e2ddf56ae020492bfb not found: ID does not exist"
Jul 09 09:55:07.103355 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.103317    2563 scope.go:117] "RemoveContainer" containerID="6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027"
Jul 09 09:55:07.103553 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:07.103536    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027\": container with ID starting with 6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027 not found: ID does not exist" containerID="6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027"
Jul 09 09:55:07.103595 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.103558    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027"} err="failed to get container status \"6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027\": rpc error: code = NotFound desc = could not find container \"6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027\": container with ID starting with 6389f3e45255c814e0262f0297a0235b923ec67e5c5e9081210026d5da3c0027 not found: ID does not exist"
Jul 09 09:55:07.108337 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.108312    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"]
Jul 09 09:55:07.113887 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.113869    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8b307-predictor-94cb94958-qkdf6"]
Jul 09 09:55:07.755734 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:07.755698    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" path="/var/lib/kubelet/pods/5bec4f26-b047-49c6-9a6d-71c427f0b25b/volumes"
Jul 09 09:55:11.086258 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:11.086181    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:11.086807 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:11.086781    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 09 09:55:17.627129 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.627073    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"]
Jul 09 09:55:17.627598 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.627318    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container" containerID="cri-o://2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b" gracePeriod=30
Jul 09 09:55:17.627598 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.627386    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kube-rbac-proxy" containerID="cri-o://5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a" gracePeriod=30
Jul 09 09:55:17.696190 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.696160    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"]
Jul 09 09:55:17.696477 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.696465    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container"
Jul 09 09:55:17.696520 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.696479    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container"
Jul 09 09:55:17.696520 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.696501    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kube-rbac-proxy"
Jul 09 09:55:17.696520 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.696507    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kube-rbac-proxy"
Jul 09 09:55:17.696604 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.696555    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kserve-container"
Jul 09 09:55:17.696604 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.696566    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bec4f26-b047-49c6-9a6d-71c427f0b25b" containerName="kube-rbac-proxy"
Jul 09 09:55:17.699606 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.699586    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.702207 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.702182    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-42ebc-kube-rbac-proxy-sar-config\""
Jul 09 09:55:17.702332 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.702259    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-42ebc-predictor-serving-cert\""
Jul 09 09:55:17.710297 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.710275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"]
Jul 09 09:55:17.756653 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.756626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.756799 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.756670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be390e27-d69e-496c-b262-531a44449945-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.756799 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.756721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbzv4\" (UniqueName: \"kubernetes.io/projected/be390e27-d69e-496c-b262-531a44449945-kube-api-access-jbzv4\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.858068 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.858032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.858283 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.858090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be390e27-d69e-496c-b262-531a44449945-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.858283 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.858127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbzv4\" (UniqueName: \"kubernetes.io/projected/be390e27-d69e-496c-b262-531a44449945-kube-api-access-jbzv4\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.858283 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:17.858197    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-serving-cert: secret "success-200-isvc-42ebc-predictor-serving-cert" not found
Jul 09 09:55:17.858283 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:17.858271    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls podName:be390e27-d69e-496c-b262-531a44449945 nodeName:}" failed. No retries permitted until 2026-07-09 09:55:18.358249247 +0000 UTC m=+1353.092124919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls") pod "success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" (UID: "be390e27-d69e-496c-b262-531a44449945") : secret "success-200-isvc-42ebc-predictor-serving-cert" not found
Jul 09 09:55:17.858799 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.858780    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be390e27-d69e-496c-b262-531a44449945-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:17.867686 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:17.867668    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbzv4\" (UniqueName: \"kubernetes.io/projected/be390e27-d69e-496c-b262-531a44449945-kube-api-access-jbzv4\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:18.132054 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:18.132024    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerID="5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a" exitCode=2
Jul 09 09:55:18.132232 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:18.132108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" event={"ID":"ee03df07-0340-4983-b3e2-b5e90c60705e","Type":"ContainerDied","Data":"5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a"}
Jul 09 09:55:18.362631 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:18.362585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:18.364945 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:18.364925    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls\") pod \"success-200-isvc-42ebc-predictor-7944cc6db6-spf5t\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") " pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:18.610851 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:18.610812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:18.740546 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:18.740522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"]
Jul 09 09:55:18.742344 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:55:18.742312    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe390e27_d69e_496c_b262_531a44449945.slice/crio-c5f3876f3e91cefd18b6ebc179431369ef66689c3fe2f171b067f6d1ebbad867 WatchSource:0}: Error finding container c5f3876f3e91cefd18b6ebc179431369ef66689c3fe2f171b067f6d1ebbad867: Status 404 returned error can't find the container with id c5f3876f3e91cefd18b6ebc179431369ef66689c3fe2f171b067f6d1ebbad867
Jul 09 09:55:19.138151 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:19.138040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" event={"ID":"be390e27-d69e-496c-b262-531a44449945","Type":"ContainerStarted","Data":"06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca"}
Jul 09 09:55:19.138151 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:19.138124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" event={"ID":"be390e27-d69e-496c-b262-531a44449945","Type":"ContainerStarted","Data":"a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7"}
Jul 09 09:55:19.138151 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:19.138152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:19.138375 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:19.138174    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:19.138375 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:19.138192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" event={"ID":"be390e27-d69e-496c-b262-531a44449945","Type":"ContainerStarted","Data":"c5f3876f3e91cefd18b6ebc179431369ef66689c3fe2f171b067f6d1ebbad867"}
Jul 09 09:55:19.139363 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:19.139337    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Jul 09 09:55:19.157007 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:19.156956    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podStartSLOduration=2.15694139 podStartE2EDuration="2.15694139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:55:19.155335312 +0000 UTC m=+1353.889210995" watchObservedRunningTime="2026-07-09 09:55:19.15694139 +0000 UTC m=+1353.890817073"
Jul 09 09:55:20.143180 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.143139    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Jul 09 09:55:20.775213 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.775185    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:55:20.883965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.883884    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-rbac-proxy-sar-config\") pod \"ee03df07-0340-4983-b3e2-b5e90c60705e\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") "
Jul 09 09:55:20.883965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.883929    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dxn9\" (UniqueName: \"kubernetes.io/projected/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-api-access-5dxn9\") pod \"ee03df07-0340-4983-b3e2-b5e90c60705e\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") "
Jul 09 09:55:20.883965 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.883958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls\") pod \"ee03df07-0340-4983-b3e2-b5e90c60705e\" (UID: \"ee03df07-0340-4983-b3e2-b5e90c60705e\") "
Jul 09 09:55:20.884343 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.884316    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ee03df07-0340-4983-b3e2-b5e90c60705e" (UID: "ee03df07-0340-4983-b3e2-b5e90c60705e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:55:20.886057 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.886032    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ee03df07-0340-4983-b3e2-b5e90c60705e" (UID: "ee03df07-0340-4983-b3e2-b5e90c60705e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:55:20.886148 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.886111    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-api-access-5dxn9" (OuterVolumeSpecName: "kube-api-access-5dxn9") pod "ee03df07-0340-4983-b3e2-b5e90c60705e" (UID: "ee03df07-0340-4983-b3e2-b5e90c60705e"). InnerVolumeSpecName "kube-api-access-5dxn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:55:20.984677 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.984639    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:55:20.984677 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.984673    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dxn9\" (UniqueName: \"kubernetes.io/projected/ee03df07-0340-4983-b3e2-b5e90c60705e-kube-api-access-5dxn9\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:55:20.984677 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:20.984683    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee03df07-0340-4983-b3e2-b5e90c60705e-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:55:21.087318 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.087278    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 09 09:55:21.148720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.148635    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerID="2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b" exitCode=0
Jul 09 09:55:21.148720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.148669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" event={"ID":"ee03df07-0340-4983-b3e2-b5e90c60705e","Type":"ContainerDied","Data":"2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b"}
Jul 09 09:55:21.149215 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.148682    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"
Jul 09 09:55:21.149215 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.148753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl" event={"ID":"ee03df07-0340-4983-b3e2-b5e90c60705e","Type":"ContainerDied","Data":"9b44280ec48603f952b40bf89cf0bc473f635cf4aa103c78741a567e47d69aa7"}
Jul 09 09:55:21.149215 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.148783    2563 scope.go:117] "RemoveContainer" containerID="5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a"
Jul 09 09:55:21.157675 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.157656    2563 scope.go:117] "RemoveContainer" containerID="2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b"
Jul 09 09:55:21.164763 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.164742    2563 scope.go:117] "RemoveContainer" containerID="5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a"
Jul 09 09:55:21.164999 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:21.164980    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a\": container with ID starting with 5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a not found: ID does not exist" containerID="5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a"
Jul 09 09:55:21.165045 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.165008    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a"} err="failed to get container status \"5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a\": rpc error: code = NotFound desc = could not find container \"5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a\": container with ID starting with 5fab23e8fd7a4fdff653b331d01bdeef1d7febadc21b8283042c384c3c042a7a not found: ID does not exist"
Jul 09 09:55:21.165045 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.165024    2563 scope.go:117] "RemoveContainer" containerID="2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b"
Jul 09 09:55:21.165252 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:55:21.165235    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b\": container with ID starting with 2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b not found: ID does not exist" containerID="2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b"
Jul 09 09:55:21.165293 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.165257    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b"} err="failed to get container status \"2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b\": rpc error: code = NotFound desc = could not find container \"2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b\": container with ID starting with 2729a4ffe5ac5081b6f7ceed69b481cbf80bd26261bb20ffa437a39511e1219b not found: ID does not exist"
Jul 09 09:55:21.170281 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.170262    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"]
Jul 09 09:55:21.176037 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.176017    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-b04db-predictor-869d74887d-c7bcl"]
Jul 09 09:55:21.756449 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:21.756414    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" path="/var/lib/kubelet/pods/ee03df07-0340-4983-b3e2-b5e90c60705e/volumes"
Jul 09 09:55:25.148520 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:25.148490    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:55:25.148943 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:25.148917    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Jul 09 09:55:31.087112 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:31.087051    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 09 09:55:35.149715 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:35.149673    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Jul 09 09:55:41.086990 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:41.086956    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 09 09:55:45.148930 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:45.148893    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Jul 09 09:55:51.088200 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:51.088173    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:55:55.149890 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:55:55.149847    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Jul 09 09:56:05.150037 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:05.150010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 09:56:13.529722 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.529669    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"]
Jul 09 09:56:13.530260 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.529976    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container" containerID="cri-o://f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624" gracePeriod=30
Jul 09 09:56:13.530260 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.530035    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kube-rbac-proxy" containerID="cri-o://bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40" gracePeriod=30
Jul 09 09:56:13.580809 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.580776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"]
Jul 09 09:56:13.581130 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.581105    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kube-rbac-proxy"
Jul 09 09:56:13.581130 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.581132    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kube-rbac-proxy"
Jul 09 09:56:13.581216 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.581158    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container"
Jul 09 09:56:13.581216 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.581164    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container"
Jul 09 09:56:13.581277 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.581222    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kube-rbac-proxy"
Jul 09 09:56:13.581277 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.581234    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee03df07-0340-4983-b3e2-b5e90c60705e" containerName="kserve-container"
Jul 09 09:56:13.585703 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.585682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.588236 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.588215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2cd6b-predictor-serving-cert\""
Jul 09 09:56:13.588329 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.588219    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2cd6b-kube-rbac-proxy-sar-config\""
Jul 09 09:56:13.594623 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.594600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"]
Jul 09 09:56:13.704159 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.704120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.704339 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.704253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xprk\" (UniqueName: \"kubernetes.io/projected/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-api-access-9xprk\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.704392 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.704341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.805051 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.804945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.805051 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.805022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xprk\" (UniqueName: \"kubernetes.io/projected/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-api-access-9xprk\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.805332 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.805071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.805332 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:56:13.805141    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-serving-cert: secret "success-200-isvc-2cd6b-predictor-serving-cert" not found
Jul 09 09:56:13.805332 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:56:13.805262    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls podName:0fdaa93a-c581-465a-9675-9c74c04783ba nodeName:}" failed. No retries permitted until 2026-07-09 09:56:14.305240288 +0000 UTC m=+1409.039115953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls") pod "success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" (UID: "0fdaa93a-c581-465a-9675-9c74c04783ba") : secret "success-200-isvc-2cd6b-predictor-serving-cert" not found
Jul 09 09:56:13.805800 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.805783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:13.814556 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:13.814521    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xprk\" (UniqueName: \"kubernetes.io/projected/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-api-access-9xprk\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:14.310291 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:14.310251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:14.312689 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:14.312656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls\") pod \"success-200-isvc-2cd6b-predictor-84c765884d-xbxxn\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") " pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:14.358594 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:14.358562    2563 generic.go:356] "Generic (PLEG): container finished" podID="5052dea4-f5e4-4694-8416-126e739b6641" containerID="bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40" exitCode=2
Jul 09 09:56:14.358774 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:14.358629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" event={"ID":"5052dea4-f5e4-4694-8416-126e739b6641","Type":"ContainerDied","Data":"bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40"}
Jul 09 09:56:14.495796 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:14.495767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:14.642518 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:14.642483    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"]
Jul 09 09:56:14.645873 ip-10-0-143-234 kubenswrapper[2563]: W0709 09:56:14.645848    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdaa93a_c581_465a_9675_9c74c04783ba.slice/crio-d2cfe8d75bdc3a235a429026ab1e766139e251bdfdff308a89d0ac325426cb0b WatchSource:0}: Error finding container d2cfe8d75bdc3a235a429026ab1e766139e251bdfdff308a89d0ac325426cb0b: Status 404 returned error can't find the container with id d2cfe8d75bdc3a235a429026ab1e766139e251bdfdff308a89d0ac325426cb0b
Jul 09 09:56:15.364360 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:15.364329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" event={"ID":"0fdaa93a-c581-465a-9675-9c74c04783ba","Type":"ContainerStarted","Data":"dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9"}
Jul 09 09:56:15.364545 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:15.364388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" event={"ID":"0fdaa93a-c581-465a-9675-9c74c04783ba","Type":"ContainerStarted","Data":"134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8"}
Jul 09 09:56:15.364545 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:15.364410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" event={"ID":"0fdaa93a-c581-465a-9675-9c74c04783ba","Type":"ContainerStarted","Data":"d2cfe8d75bdc3a235a429026ab1e766139e251bdfdff308a89d0ac325426cb0b"}
Jul 09 09:56:15.364545 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:15.364447    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:15.385759 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:15.385711    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podStartSLOduration=2.385691956 podStartE2EDuration="2.385691956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:56:15.384787551 +0000 UTC m=+1410.118663234" watchObservedRunningTime="2026-07-09 09:56:15.385691956 +0000 UTC m=+1410.119567640"
Jul 09 09:56:16.083002 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.082961    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.28:8643/healthz\": dial tcp 10.132.0.28:8643: connect: connection refused"
Jul 09 09:56:16.368174 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.368073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:16.369540 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.369511    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 09 09:56:16.778692 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.778663    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:56:16.834185 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.834143    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlh7k\" (UniqueName: \"kubernetes.io/projected/5052dea4-f5e4-4694-8416-126e739b6641-kube-api-access-dlh7k\") pod \"5052dea4-f5e4-4694-8416-126e739b6641\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") "
Jul 09 09:56:16.834360 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.834216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5052dea4-f5e4-4694-8416-126e739b6641-kube-rbac-proxy-sar-config\") pod \"5052dea4-f5e4-4694-8416-126e739b6641\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") "
Jul 09 09:56:16.834360 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.834252    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls\") pod \"5052dea4-f5e4-4694-8416-126e739b6641\" (UID: \"5052dea4-f5e4-4694-8416-126e739b6641\") "
Jul 09 09:56:16.834582 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.834558    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5052dea4-f5e4-4694-8416-126e739b6641-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5052dea4-f5e4-4694-8416-126e739b6641" (UID: "5052dea4-f5e4-4694-8416-126e739b6641"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:56:16.836285 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.836245    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5052dea4-f5e4-4694-8416-126e739b6641" (UID: "5052dea4-f5e4-4694-8416-126e739b6641"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:56:16.836425 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.836361    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5052dea4-f5e4-4694-8416-126e739b6641-kube-api-access-dlh7k" (OuterVolumeSpecName: "kube-api-access-dlh7k") pod "5052dea4-f5e4-4694-8416-126e739b6641" (UID: "5052dea4-f5e4-4694-8416-126e739b6641"). InnerVolumeSpecName "kube-api-access-dlh7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:56:16.935237 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.935148    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5052dea4-f5e4-4694-8416-126e739b6641-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:56:16.935237 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.935178    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlh7k\" (UniqueName: \"kubernetes.io/projected/5052dea4-f5e4-4694-8416-126e739b6641-kube-api-access-dlh7k\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:56:16.935237 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:16.935188    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5052dea4-f5e4-4694-8416-126e739b6641-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 09:56:17.373426 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.373392    2563 generic.go:356] "Generic (PLEG): container finished" podID="5052dea4-f5e4-4694-8416-126e739b6641" containerID="f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624" exitCode=0
Jul 09 09:56:17.373838 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.373443    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"
Jul 09 09:56:17.373838 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.373482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" event={"ID":"5052dea4-f5e4-4694-8416-126e739b6641","Type":"ContainerDied","Data":"f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624"}
Jul 09 09:56:17.373838 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.373536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g" event={"ID":"5052dea4-f5e4-4694-8416-126e739b6641","Type":"ContainerDied","Data":"384346c7ee867dd599c792ae9bf2d70ef2b347a76ba46c7a90f08d7425374ce5"}
Jul 09 09:56:17.373838 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.373563    2563 scope.go:117] "RemoveContainer" containerID="bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40"
Jul 09 09:56:17.374110 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.374061    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 09 09:56:17.385684 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.383125    2563 scope.go:117] "RemoveContainer" containerID="f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624"
Jul 09 09:56:17.392781 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.392763    2563 scope.go:117] "RemoveContainer" containerID="bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40"
Jul 09 09:56:17.393066 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:56:17.393045    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40\": container with ID starting with bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40 not found: ID does not exist" containerID="bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40"
Jul 09 09:56:17.393184 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.393090    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40"} err="failed to get container status \"bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40\": rpc error: code = NotFound desc = could not find container \"bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40\": container with ID starting with bbb9d232114a6c0a8507aeba7bf9c6d8dbc8b1b62f7ccd5905b952714a1fde40 not found: ID does not exist"
Jul 09 09:56:17.393184 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.393115    2563 scope.go:117] "RemoveContainer" containerID="f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624"
Jul 09 09:56:17.393392 ip-10-0-143-234 kubenswrapper[2563]: E0709 09:56:17.393374    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624\": container with ID starting with f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624 not found: ID does not exist" containerID="f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624"
Jul 09 09:56:17.393434 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.393398    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624"} err="failed to get container status \"f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624\": rpc error: code = NotFound desc = could not find container \"f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624\": container with ID starting with f0a1d409944af145f698c3b933edc0e304d62a2beb092c7b91235ce46d363624 not found: ID does not exist"
Jul 09 09:56:17.403194 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.403167    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"]
Jul 09 09:56:17.408707 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.408684    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a3d13-predictor-8b899dc74-hvw4g"]
Jul 09 09:56:17.756493 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:17.756419    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5052dea4-f5e4-4694-8416-126e739b6641" path="/var/lib/kubelet/pods/5052dea4-f5e4-4694-8416-126e739b6641/volumes"
Jul 09 09:56:22.379180 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:22.379140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:56:22.379695 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:22.379607    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 09 09:56:32.380412 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:32.380374    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 09 09:56:42.380444 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:42.380363    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 09 09:56:52.380214 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:56:52.380176    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 09 09:57:02.381052 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:57:02.381020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 09:57:45.792720 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:57:45.792691    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 09:57:45.793643 ip-10-0-143-234 kubenswrapper[2563]: I0709 09:57:45.793623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:02:45.817642 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:02:45.817614    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:02:45.819325 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:02:45.819306    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:04:32.507706 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.507608    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"]
Jul 09 10:04:32.508282 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.507884    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" containerID="cri-o://a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7" gracePeriod=30
Jul 09 10:04:32.508282 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.508130    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kube-rbac-proxy" containerID="cri-o://06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca" gracePeriod=30
Jul 09 10:04:32.600976 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.600943    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"]
Jul 09 10:04:32.601411 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.601390    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container"
Jul 09 10:04:32.601411 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.601411    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container"
Jul 09 10:04:32.601581 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.601436    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kube-rbac-proxy"
Jul 09 10:04:32.601581 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.601443    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kube-rbac-proxy"
Jul 09 10:04:32.601581 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.601501    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kube-rbac-proxy"
Jul 09 10:04:32.601581 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.601514    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5052dea4-f5e4-4694-8416-126e739b6641" containerName="kserve-container"
Jul 09 10:04:32.604746 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.604724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.607638 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.607476    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9d678-predictor-serving-cert\""
Jul 09 10:04:32.607638 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.607502    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9d678-kube-rbac-proxy-sar-config\""
Jul 09 10:04:32.615232 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.615209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"]
Jul 09 10:04:32.713574 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.713546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f775bec-d53d-4a01-a57c-8df7bc338e0b-proxy-tls\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.713775 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.713605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.713775 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.713692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cdct\" (UniqueName: \"kubernetes.io/projected/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-api-access-4cdct\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.814954 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.814868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f775bec-d53d-4a01-a57c-8df7bc338e0b-proxy-tls\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.815158 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.814977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.815158 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.815016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cdct\" (UniqueName: \"kubernetes.io/projected/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-api-access-4cdct\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.815783 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.815753    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.817427 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.817397    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f775bec-d53d-4a01-a57c-8df7bc338e0b-proxy-tls\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.823232 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.823208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cdct\" (UniqueName: \"kubernetes.io/projected/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-api-access-4cdct\") pod \"success-200-isvc-9d678-predictor-8fffb576b-dpbtd\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") " pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:32.917971 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:32.917939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:33.061727 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.061673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"]
Jul 09 10:04:33.063994 ip-10-0-143-234 kubenswrapper[2563]: W0709 10:04:33.063971    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f775bec_d53d_4a01_a57c_8df7bc338e0b.slice/crio-91e84d2e023c4ffa0356c1962583399dc3daace16b6e6af9ec77f165df4ff3a5 WatchSource:0}: Error finding container 91e84d2e023c4ffa0356c1962583399dc3daace16b6e6af9ec77f165df4ff3a5: Status 404 returned error can't find the container with id 91e84d2e023c4ffa0356c1962583399dc3daace16b6e6af9ec77f165df4ff3a5
Jul 09 10:04:33.248138 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.248104    2563 generic.go:356] "Generic (PLEG): container finished" podID="be390e27-d69e-496c-b262-531a44449945" containerID="06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca" exitCode=2
Jul 09 10:04:33.248261 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.248156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" event={"ID":"be390e27-d69e-496c-b262-531a44449945","Type":"ContainerDied","Data":"06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca"}
Jul 09 10:04:33.249989 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.249969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" event={"ID":"9f775bec-d53d-4a01-a57c-8df7bc338e0b","Type":"ContainerStarted","Data":"20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4"}
Jul 09 10:04:33.250128 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.250018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" event={"ID":"9f775bec-d53d-4a01-a57c-8df7bc338e0b","Type":"ContainerStarted","Data":"fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1"}
Jul 09 10:04:33.250128 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.250048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" event={"ID":"9f775bec-d53d-4a01-a57c-8df7bc338e0b","Type":"ContainerStarted","Data":"91e84d2e023c4ffa0356c1962583399dc3daace16b6e6af9ec77f165df4ff3a5"}
Jul 09 10:04:33.250245 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.250131    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:33.269383 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:33.269343    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podStartSLOduration=1.269330131 podStartE2EDuration="1.269330131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:04:33.268645044 +0000 UTC m=+1908.002520727" watchObservedRunningTime="2026-07-09 10:04:33.269330131 +0000 UTC m=+1908.003205814"
Jul 09 10:04:34.254003 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:34.253974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:34.255572 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:34.255546    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Jul 09 10:04:35.144166 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:35.144126    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.29:8643/healthz\": dial tcp 10.132.0.29:8643: connect: connection refused"
Jul 09 10:04:35.149503 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:35.149480    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Jul 09 10:04:35.257764 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:35.257729    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Jul 09 10:04:35.959171 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:35.959148    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 10:04:36.042021 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.041995    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbzv4\" (UniqueName: \"kubernetes.io/projected/be390e27-d69e-496c-b262-531a44449945-kube-api-access-jbzv4\") pod \"be390e27-d69e-496c-b262-531a44449945\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") "
Jul 09 10:04:36.042205 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.042039    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls\") pod \"be390e27-d69e-496c-b262-531a44449945\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") "
Jul 09 10:04:36.042205 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.042117    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be390e27-d69e-496c-b262-531a44449945-kube-rbac-proxy-sar-config\") pod \"be390e27-d69e-496c-b262-531a44449945\" (UID: \"be390e27-d69e-496c-b262-531a44449945\") "
Jul 09 10:04:36.042501 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.042478    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be390e27-d69e-496c-b262-531a44449945-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "be390e27-d69e-496c-b262-531a44449945" (UID: "be390e27-d69e-496c-b262-531a44449945"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 10:04:36.044097 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.044058    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be390e27-d69e-496c-b262-531a44449945-kube-api-access-jbzv4" (OuterVolumeSpecName: "kube-api-access-jbzv4") pod "be390e27-d69e-496c-b262-531a44449945" (UID: "be390e27-d69e-496c-b262-531a44449945"). InnerVolumeSpecName "kube-api-access-jbzv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:04:36.044197 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.044107    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "be390e27-d69e-496c-b262-531a44449945" (UID: "be390e27-d69e-496c-b262-531a44449945"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:04:36.143640 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.143613    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be390e27-d69e-496c-b262-531a44449945-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:04:36.143640 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.143636    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be390e27-d69e-496c-b262-531a44449945-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:04:36.143640 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.143646    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbzv4\" (UniqueName: \"kubernetes.io/projected/be390e27-d69e-496c-b262-531a44449945-kube-api-access-jbzv4\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:04:36.262238 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.262204    2563 generic.go:356] "Generic (PLEG): container finished" podID="be390e27-d69e-496c-b262-531a44449945" containerID="a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7" exitCode=0
Jul 09 10:04:36.262238 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.262238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" event={"ID":"be390e27-d69e-496c-b262-531a44449945","Type":"ContainerDied","Data":"a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7"}
Jul 09 10:04:36.262742 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.262265    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"
Jul 09 10:04:36.262742 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.262301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t" event={"ID":"be390e27-d69e-496c-b262-531a44449945","Type":"ContainerDied","Data":"c5f3876f3e91cefd18b6ebc179431369ef66689c3fe2f171b067f6d1ebbad867"}
Jul 09 10:04:36.262742 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.262334    2563 scope.go:117] "RemoveContainer" containerID="06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca"
Jul 09 10:04:36.271668 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.271571    2563 scope.go:117] "RemoveContainer" containerID="a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7"
Jul 09 10:04:36.279184 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.279163    2563 scope.go:117] "RemoveContainer" containerID="06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca"
Jul 09 10:04:36.279412 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:04:36.279394    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca\": container with ID starting with 06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca not found: ID does not exist" containerID="06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca"
Jul 09 10:04:36.279493 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.279423    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca"} err="failed to get container status \"06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca\": rpc error: code = NotFound desc = could not find container \"06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca\": container with ID starting with 06683a4cd0076d9676d2aa0daf7d20c91cd0ee2c83c6f6f42785534273b261ca not found: ID does not exist"
Jul 09 10:04:36.279493 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.279444    2563 scope.go:117] "RemoveContainer" containerID="a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7"
Jul 09 10:04:36.279681 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:04:36.279665    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7\": container with ID starting with a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7 not found: ID does not exist" containerID="a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7"
Jul 09 10:04:36.279736 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.279688    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7"} err="failed to get container status \"a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7\": rpc error: code = NotFound desc = could not find container \"a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7\": container with ID starting with a8d6d80f19337acfd5aae12514b84a025c4b1b455550e1785760a071ad3690b7 not found: ID does not exist"
Jul 09 10:04:36.285730 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.285711    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"]
Jul 09 10:04:36.289693 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:36.289671    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-42ebc-predictor-7944cc6db6-spf5t"]
Jul 09 10:04:37.756043 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:37.756005    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be390e27-d69e-496c-b262-531a44449945" path="/var/lib/kubelet/pods/be390e27-d69e-496c-b262-531a44449945/volumes"
Jul 09 10:04:40.262271 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:40.262245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:04:40.262717 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:40.262677    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Jul 09 10:04:50.262684 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:04:50.262645    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Jul 09 10:05:00.263580 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:00.263541    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Jul 09 10:05:10.263720 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:10.263684    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Jul 09 10:05:20.263849 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:20.263813    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:05:28.514754 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.514722    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"]
Jul 09 10:05:28.515222 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.514994    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container" containerID="cri-o://134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8" gracePeriod=30
Jul 09 10:05:28.515333 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.515057    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kube-rbac-proxy" containerID="cri-o://dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9" gracePeriod=30
Jul 09 10:05:28.583027 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.582994    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"]
Jul 09 10:05:28.583344 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.583332    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container"
Jul 09 10:05:28.583390 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.583346    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container"
Jul 09 10:05:28.583390 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.583357    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kube-rbac-proxy"
Jul 09 10:05:28.583390 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.583363    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kube-rbac-proxy"
Jul 09 10:05:28.583481 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.583420    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kube-rbac-proxy"
Jul 09 10:05:28.583481 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.583428    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="be390e27-d69e-496c-b262-531a44449945" containerName="kserve-container"
Jul 09 10:05:28.586528 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.586513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.589327 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.589308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-52f9b-kube-rbac-proxy-sar-config\""
Jul 09 10:05:28.589460 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.589442    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-52f9b-predictor-serving-cert\""
Jul 09 10:05:28.596673 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.596651    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"]
Jul 09 10:05:28.649883 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.649857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58915a12-d808-4045-a40f-06eff6835839-proxy-tls\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.650022 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.649895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58915a12-d808-4045-a40f-06eff6835839-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.650022 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.649921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6vrz\" (UniqueName: \"kubernetes.io/projected/58915a12-d808-4045-a40f-06eff6835839-kube-api-access-c6vrz\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.751092 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.751058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58915a12-d808-4045-a40f-06eff6835839-proxy-tls\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.751283 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.751115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58915a12-d808-4045-a40f-06eff6835839-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.751283 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.751149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6vrz\" (UniqueName: \"kubernetes.io/projected/58915a12-d808-4045-a40f-06eff6835839-kube-api-access-c6vrz\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.752043 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.752013    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58915a12-d808-4045-a40f-06eff6835839-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.753716 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.753700    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58915a12-d808-4045-a40f-06eff6835839-proxy-tls\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.760262 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.760236    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6vrz\" (UniqueName: \"kubernetes.io/projected/58915a12-d808-4045-a40f-06eff6835839-kube-api-access-c6vrz\") pod \"success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") " pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:28.896984 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:28.896945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:29.032378 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.032355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"]
Jul 09 10:05:29.034217 ip-10-0-143-234 kubenswrapper[2563]: W0709 10:05:29.034189    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58915a12_d808_4045_a40f_06eff6835839.slice/crio-d026eff5428fe31e8ddf831e915e4f45762efad411607af04a4b08e4752efffb WatchSource:0}: Error finding container d026eff5428fe31e8ddf831e915e4f45762efad411607af04a4b08e4752efffb: Status 404 returned error can't find the container with id d026eff5428fe31e8ddf831e915e4f45762efad411607af04a4b08e4752efffb
Jul 09 10:05:29.469762 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.469723    2563 generic.go:356] "Generic (PLEG): container finished" podID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerID="dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9" exitCode=2
Jul 09 10:05:29.469942 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.469790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" event={"ID":"0fdaa93a-c581-465a-9675-9c74c04783ba","Type":"ContainerDied","Data":"dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9"}
Jul 09 10:05:29.471535 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.471514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" event={"ID":"58915a12-d808-4045-a40f-06eff6835839","Type":"ContainerStarted","Data":"99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309"}
Jul 09 10:05:29.471651 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.471556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" event={"ID":"58915a12-d808-4045-a40f-06eff6835839","Type":"ContainerStarted","Data":"e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29"}
Jul 09 10:05:29.471651 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.471576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" event={"ID":"58915a12-d808-4045-a40f-06eff6835839","Type":"ContainerStarted","Data":"d026eff5428fe31e8ddf831e915e4f45762efad411607af04a4b08e4752efffb"}
Jul 09 10:05:29.471651 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.471629    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:29.489534 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:29.489487    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podStartSLOduration=1.489471728 podStartE2EDuration="1.489471728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:05:29.488954 +0000 UTC m=+1964.222829683" watchObservedRunningTime="2026-07-09 10:05:29.489471728 +0000 UTC m=+1964.223347411"
Jul 09 10:05:30.475231 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:30.475204    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:30.476657 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:30.476631    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 09 10:05:31.479323 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.479287    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 09 10:05:31.671193 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.671170    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 10:05:31.776690 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.776618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xprk\" (UniqueName: \"kubernetes.io/projected/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-api-access-9xprk\") pod \"0fdaa93a-c581-465a-9675-9c74c04783ba\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") "
Jul 09 10:05:31.776690 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.776673    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-rbac-proxy-sar-config\") pod \"0fdaa93a-c581-465a-9675-9c74c04783ba\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") "
Jul 09 10:05:31.776859 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.776744    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls\") pod \"0fdaa93a-c581-465a-9675-9c74c04783ba\" (UID: \"0fdaa93a-c581-465a-9675-9c74c04783ba\") "
Jul 09 10:05:31.777069 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.777040    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "0fdaa93a-c581-465a-9675-9c74c04783ba" (UID: "0fdaa93a-c581-465a-9675-9c74c04783ba"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 10:05:31.778765 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.778739    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0fdaa93a-c581-465a-9675-9c74c04783ba" (UID: "0fdaa93a-c581-465a-9675-9c74c04783ba"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:05:31.778865 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.778829    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-api-access-9xprk" (OuterVolumeSpecName: "kube-api-access-9xprk") pod "0fdaa93a-c581-465a-9675-9c74c04783ba" (UID: "0fdaa93a-c581-465a-9675-9c74c04783ba"). InnerVolumeSpecName "kube-api-access-9xprk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:05:31.877415 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.877387    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0fdaa93a-c581-465a-9675-9c74c04783ba-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:05:31.877415 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.877411    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xprk\" (UniqueName: \"kubernetes.io/projected/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-api-access-9xprk\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:05:31.877585 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:31.877425    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0fdaa93a-c581-465a-9675-9c74c04783ba-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:05:32.484183 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.484150    2563 generic.go:356] "Generic (PLEG): container finished" podID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerID="134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8" exitCode=0
Jul 09 10:05:32.484622 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.484197    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"
Jul 09 10:05:32.484622 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.484221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" event={"ID":"0fdaa93a-c581-465a-9675-9c74c04783ba","Type":"ContainerDied","Data":"134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8"}
Jul 09 10:05:32.484622 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.484268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn" event={"ID":"0fdaa93a-c581-465a-9675-9c74c04783ba","Type":"ContainerDied","Data":"d2cfe8d75bdc3a235a429026ab1e766139e251bdfdff308a89d0ac325426cb0b"}
Jul 09 10:05:32.484999 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.484293    2563 scope.go:117] "RemoveContainer" containerID="dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9"
Jul 09 10:05:32.494589 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.494571    2563 scope.go:117] "RemoveContainer" containerID="134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8"
Jul 09 10:05:32.503508 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.503481    2563 scope.go:117] "RemoveContainer" containerID="dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9"
Jul 09 10:05:32.503755 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:05:32.503734    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9\": container with ID starting with dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9 not found: ID does not exist" containerID="dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9"
Jul 09 10:05:32.503829 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.503764    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9"} err="failed to get container status \"dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9\": rpc error: code = NotFound desc = could not find container \"dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9\": container with ID starting with dd0c1edd2fcd5a69b746f2f307be380a42581c521da86c36e4536ac425fc30a9 not found: ID does not exist"
Jul 09 10:05:32.503829 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.503780    2563 scope.go:117] "RemoveContainer" containerID="134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8"
Jul 09 10:05:32.504002 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:05:32.503983    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8\": container with ID starting with 134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8 not found: ID does not exist" containerID="134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8"
Jul 09 10:05:32.504064 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.504007    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8"} err="failed to get container status \"134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8\": rpc error: code = NotFound desc = could not find container \"134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8\": container with ID starting with 134ecdde9b0f722520dc4c4feeff89eec96019168ddd6dd37ce88c0b06594fb8 not found: ID does not exist"
Jul 09 10:05:32.508119 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.508093    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"]
Jul 09 10:05:32.511907 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:32.511887    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2cd6b-predictor-84c765884d-xbxxn"]
Jul 09 10:05:33.755518 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:33.755483    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" path="/var/lib/kubelet/pods/0fdaa93a-c581-465a-9675-9c74c04783ba/volumes"
Jul 09 10:05:36.483973 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:36.483942    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:05:36.484388 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:36.484364    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 09 10:05:42.835809 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.835774    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"]
Jul 09 10:05:42.836257 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.836095    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container" containerID="cri-o://fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1" gracePeriod=30
Jul 09 10:05:42.836257 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.836114    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kube-rbac-proxy" containerID="cri-o://20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4" gracePeriod=30
Jul 09 10:05:42.863104 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.863057    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"]
Jul 09 10:05:42.863414 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.863400    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kube-rbac-proxy"
Jul 09 10:05:42.863455 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.863416    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kube-rbac-proxy"
Jul 09 10:05:42.863455 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.863431    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container"
Jul 09 10:05:42.863455 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.863437    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container"
Jul 09 10:05:42.863547 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.863493    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kserve-container"
Jul 09 10:05:42.863547 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.863505    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdaa93a-c581-465a-9675-9c74c04783ba" containerName="kube-rbac-proxy"
Jul 09 10:05:42.867555 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.867539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:42.870119 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.870070    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a7fc2-predictor-serving-cert\""
Jul 09 10:05:42.870338 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.870323    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a7fc2-kube-rbac-proxy-sar-config\""
Jul 09 10:05:42.877610 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.877592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"]
Jul 09 10:05:42.963523 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.963478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lw22\" (UniqueName: \"kubernetes.io/projected/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-api-access-5lw22\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:42.963698 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.963644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:42.963760 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:42.963706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.065178 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.065139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.065374 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.065197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.065374 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.065237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lw22\" (UniqueName: \"kubernetes.io/projected/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-api-access-5lw22\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.065374 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:05:43.065276    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-serving-cert: secret "success-200-isvc-a7fc2-predictor-serving-cert" not found
Jul 09 10:05:43.065374 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:05:43.065348    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls podName:e1beb144-3c0f-4f83-b7d3-91dde73aaf1d nodeName:}" failed. No retries permitted until 2026-07-09 10:05:43.56533116 +0000 UTC m=+1978.299206825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls") pod "success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" (UID: "e1beb144-3c0f-4f83-b7d3-91dde73aaf1d") : secret "success-200-isvc-a7fc2-predictor-serving-cert" not found
Jul 09 10:05:43.065872 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.065854    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.076653 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.076629    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lw22\" (UniqueName: \"kubernetes.io/projected/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-api-access-5lw22\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.533468 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.533434    2563 generic.go:356] "Generic (PLEG): container finished" podID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerID="20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4" exitCode=2
Jul 09 10:05:43.533636 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.533504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" event={"ID":"9f775bec-d53d-4a01-a57c-8df7bc338e0b","Type":"ContainerDied","Data":"20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4"}
Jul 09 10:05:43.570317 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.570279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.572631 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.572613    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls\") pod \"success-200-isvc-a7fc2-predictor-864477b95b-zg9gh\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") " pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.778160 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.778130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:43.913998 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:43.913964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"]
Jul 09 10:05:43.916877 ip-10-0-143-234 kubenswrapper[2563]: W0709 10:05:43.916841    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1beb144_3c0f_4f83_b7d3_91dde73aaf1d.slice/crio-d0cdade46ed4196e46a0ae41f05743f42ce69e3c82189ea8fb0671679d94c425 WatchSource:0}: Error finding container d0cdade46ed4196e46a0ae41f05743f42ce69e3c82189ea8fb0671679d94c425: Status 404 returned error can't find the container with id d0cdade46ed4196e46a0ae41f05743f42ce69e3c82189ea8fb0671679d94c425
Jul 09 10:05:44.538770 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:44.538724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" event={"ID":"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d","Type":"ContainerStarted","Data":"a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce"}
Jul 09 10:05:44.538964 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:44.538787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" event={"ID":"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d","Type":"ContainerStarted","Data":"ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad"}
Jul 09 10:05:44.538964 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:44.538817    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:44.538964 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:44.538845    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:44.538964 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:44.538861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" event={"ID":"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d","Type":"ContainerStarted","Data":"d0cdade46ed4196e46a0ae41f05743f42ce69e3c82189ea8fb0671679d94c425"}
Jul 09 10:05:44.540329 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:44.540303    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 09 10:05:44.560533 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:44.560489    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podStartSLOduration=2.560475356 podStartE2EDuration="2.560475356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:05:44.559759122 +0000 UTC m=+1979.293634808" watchObservedRunningTime="2026-07-09 10:05:44.560475356 +0000 UTC m=+1979.294351039"
Jul 09 10:05:45.258144 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:45.258068    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused"
Jul 09 10:05:45.543122 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:45.543019    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 09 10:05:45.984776 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:45.984750    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:05:46.091455 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.091430    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-rbac-proxy-sar-config\") pod \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") "
Jul 09 10:05:46.091622 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.091467    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cdct\" (UniqueName: \"kubernetes.io/projected/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-api-access-4cdct\") pod \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") "
Jul 09 10:05:46.091622 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.091527    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f775bec-d53d-4a01-a57c-8df7bc338e0b-proxy-tls\") pod \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\" (UID: \"9f775bec-d53d-4a01-a57c-8df7bc338e0b\") "
Jul 09 10:05:46.091813 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.091789    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9f775bec-d53d-4a01-a57c-8df7bc338e0b" (UID: "9f775bec-d53d-4a01-a57c-8df7bc338e0b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 10:05:46.093565 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.093539    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f775bec-d53d-4a01-a57c-8df7bc338e0b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9f775bec-d53d-4a01-a57c-8df7bc338e0b" (UID: "9f775bec-d53d-4a01-a57c-8df7bc338e0b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:05:46.093682 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.093604    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-api-access-4cdct" (OuterVolumeSpecName: "kube-api-access-4cdct") pod "9f775bec-d53d-4a01-a57c-8df7bc338e0b" (UID: "9f775bec-d53d-4a01-a57c-8df7bc338e0b"). InnerVolumeSpecName "kube-api-access-4cdct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:05:46.192603 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.192566    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f775bec-d53d-4a01-a57c-8df7bc338e0b-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:05:46.192603 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.192596    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:05:46.192603 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.192608    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cdct\" (UniqueName: \"kubernetes.io/projected/9f775bec-d53d-4a01-a57c-8df7bc338e0b-kube-api-access-4cdct\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:05:46.484597 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.484490    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 09 10:05:46.548625 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.548592    2563 generic.go:356] "Generic (PLEG): container finished" podID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerID="fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1" exitCode=0
Jul 09 10:05:46.548794 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.548638    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"
Jul 09 10:05:46.548794 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.548637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" event={"ID":"9f775bec-d53d-4a01-a57c-8df7bc338e0b","Type":"ContainerDied","Data":"fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1"}
Jul 09 10:05:46.548794 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.548772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd" event={"ID":"9f775bec-d53d-4a01-a57c-8df7bc338e0b","Type":"ContainerDied","Data":"91e84d2e023c4ffa0356c1962583399dc3daace16b6e6af9ec77f165df4ff3a5"}
Jul 09 10:05:46.548966 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.548809    2563 scope.go:117] "RemoveContainer" containerID="20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4"
Jul 09 10:05:46.557305 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.557282    2563 scope.go:117] "RemoveContainer" containerID="fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1"
Jul 09 10:05:46.564365 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.564347    2563 scope.go:117] "RemoveContainer" containerID="20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4"
Jul 09 10:05:46.564603 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:05:46.564586    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4\": container with ID starting with 20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4 not found: ID does not exist" containerID="20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4"
Jul 09 10:05:46.564640 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.564610    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4"} err="failed to get container status \"20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4\": rpc error: code = NotFound desc = could not find container \"20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4\": container with ID starting with 20f4b837f3561464c54f096ee0eee91f1b0183937957d7ebf6edc6057752f3a4 not found: ID does not exist"
Jul 09 10:05:46.564640 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.564628    2563 scope.go:117] "RemoveContainer" containerID="fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1"
Jul 09 10:05:46.564858 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:05:46.564842    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1\": container with ID starting with fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1 not found: ID does not exist" containerID="fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1"
Jul 09 10:05:46.564895 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.564864    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1"} err="failed to get container status \"fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1\": rpc error: code = NotFound desc = could not find container \"fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1\": container with ID starting with fdc9b1682c11b2803c458502f053882d186083b17e15af4bc65fe5c91f2ea4c1 not found: ID does not exist"
Jul 09 10:05:46.570626 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.570606    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"]
Jul 09 10:05:46.575175 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:46.575156    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9d678-predictor-8fffb576b-dpbtd"]
Jul 09 10:05:47.755618 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:47.755591    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" path="/var/lib/kubelet/pods/9f775bec-d53d-4a01-a57c-8df7bc338e0b/volumes"
Jul 09 10:05:50.549012 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:50.548986    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:05:50.549464 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:50.549438    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 09 10:05:56.484601 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:05:56.484563    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 09 10:06:00.549545 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:06:00.549502    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 09 10:06:06.484882 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:06:06.484844    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 09 10:06:10.549849 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:06:10.549812    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 09 10:06:16.485647 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:06:16.485620    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:06:20.549756 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:06:20.549718    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 09 10:06:30.550864 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:06:30.550836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:07:45.848649 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:07:45.848618    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:07:45.851051 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:07:45.848625    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:12:45.872909 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:12:45.872802    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:12:45.875879 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:12:45.873941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:14:57.902147 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:14:57.902116    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"]
Jul 09 10:14:57.902659 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:14:57.902344    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" containerID="cri-o://ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad" gracePeriod=30
Jul 09 10:14:57.902659 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:14:57.902374    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kube-rbac-proxy" containerID="cri-o://a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce" gracePeriod=30
Jul 09 10:14:58.661997 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:14:58.661963    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerID="a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce" exitCode=2
Jul 09 10:14:58.662183 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:14:58.662036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" event={"ID":"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d","Type":"ContainerDied","Data":"a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce"}
Jul 09 10:15:00.543609 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:00.543562    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused"
Jul 09 10:15:00.549924 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:00.549890    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 09 10:15:00.955261 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:00.955238    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:15:01.090472 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.090440    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls\") pod \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") "
Jul 09 10:15:01.090666 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.090520    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lw22\" (UniqueName: \"kubernetes.io/projected/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-api-access-5lw22\") pod \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") "
Jul 09 10:15:01.090666 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.090541    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-rbac-proxy-sar-config\") pod \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\" (UID: \"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d\") "
Jul 09 10:15:01.090890 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.090870    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" (UID: "e1beb144-3c0f-4f83-b7d3-91dde73aaf1d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 10:15:01.092648 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.092622    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-api-access-5lw22" (OuterVolumeSpecName: "kube-api-access-5lw22") pod "e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" (UID: "e1beb144-3c0f-4f83-b7d3-91dde73aaf1d"). InnerVolumeSpecName "kube-api-access-5lw22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:15:01.092743 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.092683    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" (UID: "e1beb144-3c0f-4f83-b7d3-91dde73aaf1d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:15:01.192037 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.191990    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:15:01.192037 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.192034    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lw22\" (UniqueName: \"kubernetes.io/projected/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-api-access-5lw22\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:15:01.192037 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.192045    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:15:01.676522 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.676490    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerID="ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad" exitCode=0
Jul 09 10:15:01.677009 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.676526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" event={"ID":"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d","Type":"ContainerDied","Data":"ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad"}
Jul 09 10:15:01.677009 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.676606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh" event={"ID":"e1beb144-3c0f-4f83-b7d3-91dde73aaf1d","Type":"ContainerDied","Data":"d0cdade46ed4196e46a0ae41f05743f42ce69e3c82189ea8fb0671679d94c425"}
Jul 09 10:15:01.677009 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.676543    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"
Jul 09 10:15:01.677009 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.676645    2563 scope.go:117] "RemoveContainer" containerID="a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce"
Jul 09 10:15:01.686627 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.686604    2563 scope.go:117] "RemoveContainer" containerID="ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad"
Jul 09 10:15:01.694430 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.694411    2563 scope.go:117] "RemoveContainer" containerID="a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce"
Jul 09 10:15:01.694712 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:15:01.694688    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce\": container with ID starting with a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce not found: ID does not exist" containerID="a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce"
Jul 09 10:15:01.694798 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.694725    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce"} err="failed to get container status \"a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce\": rpc error: code = NotFound desc = could not find container \"a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce\": container with ID starting with a5dbe578a511e8d4a2ef3a12a56381a9bfabc5be298e639cfada8afc48e2b7ce not found: ID does not exist"
Jul 09 10:15:01.694798 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.694750    2563 scope.go:117] "RemoveContainer" containerID="ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad"
Jul 09 10:15:01.695006 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:15:01.694989    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad\": container with ID starting with ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad not found: ID does not exist" containerID="ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad"
Jul 09 10:15:01.695049 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.695012    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad"} err="failed to get container status \"ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad\": rpc error: code = NotFound desc = could not find container \"ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad\": container with ID starting with ffd66309f9d13aeae652f79d9083cb54df7ba11512f265812e456d6388b0a3ad not found: ID does not exist"
Jul 09 10:15:01.702859 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.702830    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"]
Jul 09 10:15:01.706429 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.706406    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a7fc2-predictor-864477b95b-zg9gh"]
Jul 09 10:15:01.755159 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:15:01.755127    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" path="/var/lib/kubelet/pods/e1beb144-3c0f-4f83-b7d3-91dde73aaf1d/volumes"
Jul 09 10:17:45.895687 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:17:45.895581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:17:45.898680 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:17:45.897814    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:22:45.918820 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:45.918711    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:22:45.921803 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:45.920768    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:22:48.075744 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:48.075709    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"]
Jul 09 10:22:48.076281 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:48.075996    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container" containerID="cri-o://e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29" gracePeriod=30
Jul 09 10:22:48.076281 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:48.076030    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kube-rbac-proxy" containerID="cri-o://99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309" gracePeriod=30
Jul 09 10:22:48.421426 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:48.421395    2563 generic.go:356] "Generic (PLEG): container finished" podID="58915a12-d808-4045-a40f-06eff6835839" containerID="99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309" exitCode=2
Jul 09 10:22:48.421613 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:48.421466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" event={"ID":"58915a12-d808-4045-a40f-06eff6835839","Type":"ContainerDied","Data":"99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309"}
Jul 09 10:22:51.425608 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.425583    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:22:51.433790 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.433762    2563 generic.go:356] "Generic (PLEG): container finished" podID="58915a12-d808-4045-a40f-06eff6835839" containerID="e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29" exitCode=0
Jul 09 10:22:51.433963 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.433815    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"
Jul 09 10:22:51.433963 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.433843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" event={"ID":"58915a12-d808-4045-a40f-06eff6835839","Type":"ContainerDied","Data":"e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29"}
Jul 09 10:22:51.433963 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.433901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g" event={"ID":"58915a12-d808-4045-a40f-06eff6835839","Type":"ContainerDied","Data":"d026eff5428fe31e8ddf831e915e4f45762efad411607af04a4b08e4752efffb"}
Jul 09 10:22:51.433963 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.433927    2563 scope.go:117] "RemoveContainer" containerID="99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309"
Jul 09 10:22:51.441832 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.441811    2563 scope.go:117] "RemoveContainer" containerID="e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29"
Jul 09 10:22:51.450210 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.450193    2563 scope.go:117] "RemoveContainer" containerID="99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309"
Jul 09 10:22:51.450530 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:22:51.450513    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309\": container with ID starting with 99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309 not found: ID does not exist" containerID="99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309"
Jul 09 10:22:51.450598 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.450537    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309"} err="failed to get container status \"99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309\": rpc error: code = NotFound desc = could not find container \"99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309\": container with ID starting with 99e2a4ad526506949a727f25912b9aa584b207553128daca95597d51d2180309 not found: ID does not exist"
Jul 09 10:22:51.450598 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.450552    2563 scope.go:117] "RemoveContainer" containerID="e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29"
Jul 09 10:22:51.450818 ip-10-0-143-234 kubenswrapper[2563]: E0709 10:22:51.450801    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29\": container with ID starting with e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29 not found: ID does not exist" containerID="e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29"
Jul 09 10:22:51.450886 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.450822    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29"} err="failed to get container status \"e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29\": rpc error: code = NotFound desc = could not find container \"e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29\": container with ID starting with e31e058e922fafa56a73122d0c21df7fe02724d156ba637f43d0a79bdd8f6c29 not found: ID does not exist"
Jul 09 10:22:51.599492 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.599460    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58915a12-d808-4045-a40f-06eff6835839-kube-rbac-proxy-sar-config\") pod \"58915a12-d808-4045-a40f-06eff6835839\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") "
Jul 09 10:22:51.599644 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.599535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58915a12-d808-4045-a40f-06eff6835839-proxy-tls\") pod \"58915a12-d808-4045-a40f-06eff6835839\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") "
Jul 09 10:22:51.599644 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.599598    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6vrz\" (UniqueName: \"kubernetes.io/projected/58915a12-d808-4045-a40f-06eff6835839-kube-api-access-c6vrz\") pod \"58915a12-d808-4045-a40f-06eff6835839\" (UID: \"58915a12-d808-4045-a40f-06eff6835839\") "
Jul 09 10:22:51.599930 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.599898    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58915a12-d808-4045-a40f-06eff6835839-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "58915a12-d808-4045-a40f-06eff6835839" (UID: "58915a12-d808-4045-a40f-06eff6835839"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 10:22:51.601600 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.601581    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58915a12-d808-4045-a40f-06eff6835839-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "58915a12-d808-4045-a40f-06eff6835839" (UID: "58915a12-d808-4045-a40f-06eff6835839"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:22:51.601686 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.601665    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58915a12-d808-4045-a40f-06eff6835839-kube-api-access-c6vrz" (OuterVolumeSpecName: "kube-api-access-c6vrz") pod "58915a12-d808-4045-a40f-06eff6835839" (UID: "58915a12-d808-4045-a40f-06eff6835839"). InnerVolumeSpecName "kube-api-access-c6vrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:22:51.701169 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.701135    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58915a12-d808-4045-a40f-06eff6835839-proxy-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:22:51.701169 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.701163    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6vrz\" (UniqueName: \"kubernetes.io/projected/58915a12-d808-4045-a40f-06eff6835839-kube-api-access-c6vrz\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:22:51.701169 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.701172    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58915a12-d808-4045-a40f-06eff6835839-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 09 10:22:51.756682 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.756649    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"]
Jul 09 10:22:51.760286 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:51.760259    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-52f9b-predictor-9f9dc8c54-cs84g"]
Jul 09 10:22:53.755721 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:22:53.755686    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58915a12-d808-4045-a40f-06eff6835839" path="/var/lib/kubelet/pods/58915a12-d808-4045-a40f-06eff6835839/volumes"
Jul 09 10:23:20.508800 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.508766    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q8qv5/must-gather-tlk24"]
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509032    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509044    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509057    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509062    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509069    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509075    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509100    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509105    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509116    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509122    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509131    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509136    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509183    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509190    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="58915a12-d808-4045-a40f-06eff6835839" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509197    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509201    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kube-rbac-proxy"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509208    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1beb144-3c0f-4f83-b7d3-91dde73aaf1d" containerName="kserve-container"
Jul 09 10:23:20.509275 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.509214    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f775bec-d53d-4a01-a57c-8df7bc338e0b" containerName="kserve-container"
Jul 09 10:23:20.512124 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.512106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.515024 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.514995    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q8qv5\"/\"openshift-service-ca.crt\""
Jul 09 10:23:20.515228 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.515169    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q8qv5\"/\"kube-root-ca.crt\""
Jul 09 10:23:20.516344 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.516329    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q8qv5\"/\"default-dockercfg-4jsqr\""
Jul 09 10:23:20.520071 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.520043    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qv5/must-gather-tlk24"]
Jul 09 10:23:20.605883 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.605838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnpmk\" (UniqueName: \"kubernetes.io/projected/da2d6f41-e113-41e2-8a58-734ea3a737a9-kube-api-access-rnpmk\") pod \"must-gather-tlk24\" (UID: \"da2d6f41-e113-41e2-8a58-734ea3a737a9\") " pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.606005 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.605903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/da2d6f41-e113-41e2-8a58-734ea3a737a9-must-gather-output\") pod \"must-gather-tlk24\" (UID: \"da2d6f41-e113-41e2-8a58-734ea3a737a9\") " pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.706510 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.706481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/da2d6f41-e113-41e2-8a58-734ea3a737a9-must-gather-output\") pod \"must-gather-tlk24\" (UID: \"da2d6f41-e113-41e2-8a58-734ea3a737a9\") " pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.706646 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.706544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnpmk\" (UniqueName: \"kubernetes.io/projected/da2d6f41-e113-41e2-8a58-734ea3a737a9-kube-api-access-rnpmk\") pod \"must-gather-tlk24\" (UID: \"da2d6f41-e113-41e2-8a58-734ea3a737a9\") " pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.706869 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.706849    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/da2d6f41-e113-41e2-8a58-734ea3a737a9-must-gather-output\") pod \"must-gather-tlk24\" (UID: \"da2d6f41-e113-41e2-8a58-734ea3a737a9\") " pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.715242 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.715224    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnpmk\" (UniqueName: \"kubernetes.io/projected/da2d6f41-e113-41e2-8a58-734ea3a737a9-kube-api-access-rnpmk\") pod \"must-gather-tlk24\" (UID: \"da2d6f41-e113-41e2-8a58-734ea3a737a9\") " pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.821587 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.821503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qv5/must-gather-tlk24"
Jul 09 10:23:20.951262 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.951236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qv5/must-gather-tlk24"]
Jul 09 10:23:20.953892 ip-10-0-143-234 kubenswrapper[2563]: W0709 10:23:20.953864    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda2d6f41_e113_41e2_8a58_734ea3a737a9.slice/crio-0a6a202392254c854fa876565e6db0bba505ae18027e60ad4cb6dd4733db7e37 WatchSource:0}: Error finding container 0a6a202392254c854fa876565e6db0bba505ae18027e60ad4cb6dd4733db7e37: Status 404 returned error can't find the container with id 0a6a202392254c854fa876565e6db0bba505ae18027e60ad4cb6dd4733db7e37
Jul 09 10:23:20.956056 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:20.956041    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 10:23:21.548204 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:21.548170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qv5/must-gather-tlk24" event={"ID":"da2d6f41-e113-41e2-8a58-734ea3a737a9","Type":"ContainerStarted","Data":"0a6a202392254c854fa876565e6db0bba505ae18027e60ad4cb6dd4733db7e37"}
Jul 09 10:23:23.560063 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:23.559305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qv5/must-gather-tlk24" event={"ID":"da2d6f41-e113-41e2-8a58-734ea3a737a9","Type":"ContainerStarted","Data":"362c2c3557b932aea4c6806c5b57c11cc55eba903fd9f45262636d7b84e27b1e"}
Jul 09 10:23:23.560063 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:23.559358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qv5/must-gather-tlk24" event={"ID":"da2d6f41-e113-41e2-8a58-734ea3a737a9","Type":"ContainerStarted","Data":"41b44bce463b12fb2b85e52a79d3dc289b721613b3292a38a3aa005e5904b669"}
Jul 09 10:23:23.583206 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:23.583157    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q8qv5/must-gather-tlk24" podStartSLOduration=1.685485916 podStartE2EDuration="3.583142231s" totalImagesPullingTime="1.897656315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:23:23.58307501 +0000 UTC m=+3038.316950695" watchObservedRunningTime="2026-07-09 10:23:23.583142231 +0000 UTC m=+3038.317017914"
Jul 09 10:23:24.396678 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:24.396634    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c8gdf_a1ede5b3-978a-4e74-b910-b1fda01f7af1/global-pull-secret-syncer/0.log"
Jul 09 10:23:24.597381 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:24.597345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tqxkv_5949b15b-4177-41bb-af59-ae0ff053647b/konnectivity-agent/0.log"
Jul 09 10:23:24.676636 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:24.676527    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-234.ec2.internal_80846f74a51c761123ee116b63300c13/haproxy/0.log"
Jul 09 10:23:28.024744 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:28.024697    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-27p4f_356d261a-480d-461f-8262-aff9e6e0aa15/cluster-monitoring-operator/0.log"
Jul 09 10:23:28.427215 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:28.427187    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmwhn_6e52ae28-c9d5-4b49-960f-54f5d17d9df5/node-exporter/0.log"
Jul 09 10:23:28.474646 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:28.474600    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmwhn_6e52ae28-c9d5-4b49-960f-54f5d17d9df5/kube-rbac-proxy/0.log"
Jul 09 10:23:28.514074 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:28.513975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmwhn_6e52ae28-c9d5-4b49-960f-54f5d17d9df5/init-textfile/0.log"
Jul 09 10:23:29.065640 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:29.065610    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6czd7_3f2c0506-3ccd-46cf-8e5b-3c94777b752d/prometheus-operator-admission-webhook/0.log"
Jul 09 10:23:30.660912 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:30.660886    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-vnqlv_1ed15081-1fd1-40d8-aead-4a31e3a96cae/networking-console-plugin/0.log"
Jul 09 10:23:31.173340 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:31.173306    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/2.log"
Jul 09 10:23:31.179766 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:31.179742    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bfvcl_8ebf28d7-9183-417d-852a-5fb7d651c0eb/console-operator/3.log"
Jul 09 10:23:32.173233 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.173206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-gj6rk_ad36c019-17af-4898-b4c8-33680b4da149/volume-data-source-validator/0.log"
Jul 09 10:23:32.848660 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.848621    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"]
Jul 09 10:23:32.854566 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.854536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:32.863187 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.862983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"]
Jul 09 10:23:32.911106 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.910779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-podres\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:32.911106 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.910838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tktn4\" (UniqueName: \"kubernetes.io/projected/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-kube-api-access-tktn4\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:32.911106 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.910880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-lib-modules\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:32.911106 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.910904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-proc\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:32.911106 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:32.910934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-sys\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.011807 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.011758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tktn4\" (UniqueName: \"kubernetes.io/projected/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-kube-api-access-tktn4\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.011981 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.011824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-lib-modules\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.011981 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.011855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-proc\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.011981 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.011887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-sys\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.011981 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.011976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-podres\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.012294 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.012155    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-podres\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.012503 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.012477    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-proc\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.012648 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.012624    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-lib-modules\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.012737 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.012519    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-sys\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.021486 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.021462    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tktn4\" (UniqueName: \"kubernetes.io/projected/460fce51-42a9-4b5a-8d8c-1421cd3dc7ce-kube-api-access-tktn4\") pod \"perf-node-gather-daemonset-jqsfv\" (UID: \"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce\") " pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.066834 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.066805    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-86td2_183388ee-280b-416c-ae5c-f22ebf11c0b0/dns/0.log"
Jul 09 10:23:33.088845 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.088813    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-86td2_183388ee-280b-416c-ae5c-f22ebf11c0b0/kube-rbac-proxy/0.log"
Jul 09 10:23:33.168681 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.168587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.253922 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.253893    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mw588_68bac4a3-fae4-4839-8d41-617087c1f3a3/dns-node-resolver/0.log"
Jul 09 10:23:33.328557 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.328533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"]
Jul 09 10:23:33.332034 ip-10-0-143-234 kubenswrapper[2563]: W0709 10:23:33.332008    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod460fce51_42a9_4b5a_8d8c_1421cd3dc7ce.slice/crio-d1b744cd695f1fe76740a9d1b450a2a0f4a9810881bf020c1458a78f08e442ea WatchSource:0}: Error finding container d1b744cd695f1fe76740a9d1b450a2a0f4a9810881bf020c1458a78f08e442ea: Status 404 returned error can't find the container with id d1b744cd695f1fe76740a9d1b450a2a0f4a9810881bf020c1458a78f08e442ea
Jul 09 10:23:33.610389 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.610359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv" event={"ID":"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce","Type":"ContainerStarted","Data":"7302b40ab509991ac7902fbb7c963074895b72be27f10318c55b5d93551f7858"}
Jul 09 10:23:33.610559 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.610410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv" event={"ID":"460fce51-42a9-4b5a-8d8c-1421cd3dc7ce","Type":"ContainerStarted","Data":"d1b744cd695f1fe76740a9d1b450a2a0f4a9810881bf020c1458a78f08e442ea"}
Jul 09 10:23:33.610559 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.610438    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:33.629049 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.628984    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv" podStartSLOduration=1.628962558 podStartE2EDuration="1.628962558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 10:23:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:23:33.626886929 +0000 UTC m=+3048.360762639" watchObservedRunningTime="2026-07-09 10:23:33.628962558 +0000 UTC m=+3048.362838242"
Jul 09 10:23:33.876419 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:33.876352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8h2j8_10bfbad4-7044-4a4a-aa40-b2d23abb80ae/node-ca/0.log"
Jul 09 10:23:34.817238 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:34.817212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57cd4dc8f-dv5pd_8d46f86e-d446-465d-a65f-b2654c62dc33/router/0.log"
Jul 09 10:23:35.241294 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:35.241261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgrtd_61211961-5730-4d10-a011-bde3efb0be25/serve-healthcheck-canary/0.log"
Jul 09 10:23:35.675193 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:35.675163    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jxt6q_b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e/insights-operator/0.log"
Jul 09 10:23:35.675494 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:35.675474    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jxt6q_b4d7dbd1-78f8-427e-a3ec-dd4ed1f3e59e/insights-operator/1.log"
Jul 09 10:23:35.853532 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:35.853507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk2kv_40c1d19f-e1de-4085-b760-c889d7ad459c/kube-rbac-proxy/0.log"
Jul 09 10:23:35.874622 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:35.874593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk2kv_40c1d19f-e1de-4085-b760-c889d7ad459c/exporter/0.log"
Jul 09 10:23:35.899205 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:35.899184    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hk2kv_40c1d19f-e1de-4085-b760-c889d7ad459c/extractor/0.log"
Jul 09 10:23:39.625175 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:39.625075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q8qv5/perf-node-gather-daemonset-jqsfv"
Jul 09 10:23:42.511284 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:42.511261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-p645z_9a241936-19d2-436c-a5c0-9debc6694df1/migrator/0.log"
Jul 09 10:23:42.530787 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:42.530759    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-p645z_9a241936-19d2-436c-a5c0-9debc6694df1/graceful-termination/0.log"
Jul 09 10:23:42.876667 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:42.876634    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-x5tvq_832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6/kube-storage-version-migrator-operator/1.log"
Jul 09 10:23:42.877670 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:42.877644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-x5tvq_832e8ca3-bce9-4a3d-9d4f-af0fa0dfa7a6/kube-storage-version-migrator-operator/0.log"
Jul 09 10:23:43.970023 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:43.969948    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k4w7s_050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe/kube-multus-additional-cni-plugins/0.log"
Jul 09 10:23:43.992598 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:43.992567    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k4w7s_050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe/egress-router-binary-copy/0.log"
Jul 09 10:23:44.014549 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.014523    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k4w7s_050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe/cni-plugins/0.log"
Jul 09 10:23:44.040848 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.040825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k4w7s_050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe/bond-cni-plugin/0.log"
Jul 09 10:23:44.067225 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.067203    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k4w7s_050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe/routeoverride-cni/0.log"
Jul 09 10:23:44.093880 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.093849    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k4w7s_050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe/whereabouts-cni-bincopy/0.log"
Jul 09 10:23:44.118160 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.118132    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k4w7s_050bb6ef-d0a0-48ad-ac0e-a05044f2f9fe/whereabouts-cni/0.log"
Jul 09 10:23:44.387440 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.387415    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h25c6_7bbad9af-de0a-48c8-8cf7-7fdec2a2ec2e/kube-multus/0.log"
Jul 09 10:23:44.442281 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.442260    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nwxc5_528db513-4644-4714-ae52-3bcdd7dc32cf/network-metrics-daemon/0.log"
Jul 09 10:23:44.462282 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:44.462258    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nwxc5_528db513-4644-4714-ae52-3bcdd7dc32cf/kube-rbac-proxy/0.log"
Jul 09 10:23:45.281134 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.281105    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/ovn-controller/0.log"
Jul 09 10:23:45.306945 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.306907    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/ovn-acl-logging/0.log"
Jul 09 10:23:45.333758 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.333730    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/kube-rbac-proxy-node/0.log"
Jul 09 10:23:45.354854 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.354833    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/kube-rbac-proxy-ovn-metrics/0.log"
Jul 09 10:23:45.376637 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.376620    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/northd/0.log"
Jul 09 10:23:45.397810 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.397786    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/nbdb/0.log"
Jul 09 10:23:45.423019 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.422999    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/sbdb/0.log"
Jul 09 10:23:45.474484 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:45.474458    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9479k_7c88aebb-be7d-4601-aeaa-fd649b8d1f02/ovnkube-controller/0.log"
Jul 09 10:23:46.983775 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:46.983750    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-6m8vm_4a4d7baf-d362-4c9c-96aa-0e1e4de08ad7/check-endpoints/0.log"
Jul 09 10:23:47.108510 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:47.108482    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zj2qx_0faee550-be67-4425-b562-7c2b5ec4d14b/network-check-target-container/0.log"
Jul 09 10:23:48.088425 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:48.088394    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sttbf_748e2a5b-a615-4d1d-904a-83d370f3b8da/iptables-alerter/0.log"
Jul 09 10:23:48.811397 ip-10-0-143-234 kubenswrapper[2563]: I0709 10:23:48.811370    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-v5qng_c2edc93e-9538-4404-9150-bcad662577cb/tuned/0.log"