Jul 09 17:37:17.891611 ip-10-0-141-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 17:37:17.891621 ip-10-0-141-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 17:37:17.891628 ip-10-0-141-118 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 17:37:17.891862 ip-10-0-141-118 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 17:37:28.132847 ip-10-0-141-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 17:37:28.132867 ip-10-0-141-118 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3249a97b54944d44aa9676a66547a3b9 --
Jul 09 17:39:05.821888 ip-10-0-141-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.277554    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283100    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283119    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283123    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283126    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283129    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283132    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283137    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:39:06.475144 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283141    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:39:06.359249 ip-10-0-141-118 systemd[1]: Started Kubernetes Kubelet.
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283144    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283148    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283152    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283155    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283158    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283161    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283165    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283170    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283174    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283177    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283180    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283183    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283186    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283191    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283195    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283198    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283202    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283205    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:39:06.499170 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283208    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283211    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283214    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283216    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283219    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283222    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283225    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283228    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283231    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283234    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283236    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283239    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283241    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283244    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283247    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283249    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283252    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283254    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283257    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:39:06.519064 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283259    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283262    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283266    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283269    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283271    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283274    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283277    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283280    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283283    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283292    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283296    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283298    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283301    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283304    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283306    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283309    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283312    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283314    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283317    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283320    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:39:06.519903 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283322    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283325    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283328    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283331    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283334    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283338    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283340    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283343    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283345    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283348    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283352    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283356    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283359    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283361    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283364    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283367    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283370    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283372    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283375    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283377    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:39:06.520512 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283380    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283382    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283388    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283391    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283394    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283397    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283399    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283402    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283404    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283407    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283409    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283417    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283419    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.283422    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284227    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284234    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284237    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284240    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284243    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284246    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:39:06.521333 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284249    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284252    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284255    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284258    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284260    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284263    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284265    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284268    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284272    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284277    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284280    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284283    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284286    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284288    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284291    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284295    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284298    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284300    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284303    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:39:06.521943 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284306    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284309    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284312    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284315    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284320    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284323    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284325    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284328    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284330    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284333    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284335    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284338    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284341    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284345    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284348    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284350    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284353    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284355    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284358    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284360    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:39:06.522957 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284363    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284366    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284368    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284371    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284373    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284377    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284381    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284383    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284387    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284390    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284393    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284396    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284399    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284402    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284405    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284407    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284412    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284414    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284417    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284419    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:39:06.523554 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284422    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284425    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284427    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284430    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284432    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284435    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284437    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284440    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284457    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284461    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284464    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284467    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284470    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284472    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284475    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284478    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284480    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284483    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284486    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284489    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:39:06.524324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284492    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284494    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284497    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284500    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284502    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284505    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284507    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284510    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284514    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284516    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284519    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284540    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284544    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284548    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284954    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284959    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284963    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284966    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284969    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284971    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:39:06.524947 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284975    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284978    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284980    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284983    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284985    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284988    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284991    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284994    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284996    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.284999    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285002    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285005    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285007    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285010    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285013    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285015    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285018    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285020    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285023    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:39:06.525590 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285025    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285029    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285032    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285034    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285037    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285040    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285042    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285045    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285047    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285050    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285052    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285055    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285058    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285061    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285063    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285066    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285068    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285070    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285073    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285076    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:39:06.526181 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285078    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285081    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285083    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285085    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285088    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285090    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285093    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285095    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285098    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285101    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285103    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285106    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285108    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285114    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285117    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285120    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285123    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285126    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285129    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285133    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:39:06.526807 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285136    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285138    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285141    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285144    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285146    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285148    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285151    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285153    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285156    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285158    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285162    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285164    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285167    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285169    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285172    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285174    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285177    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285179    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285181    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:39:06.527338 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285184    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285186    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285189    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285192    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285194    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285197    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285201    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285203    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285206    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285211    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285214    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285218    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285223    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285225    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.285228    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285308    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285316    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285323    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285329    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285335    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285340    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 17:39:06.527892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285346    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285353    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285357    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285362    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285366    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285369    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285372    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285375    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285379    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285382    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285385    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285388    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285392    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285395    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285399    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285402    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285405    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285416    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285419    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285422    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285425    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285429    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285432    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285436    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 17:39:06.528463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285439    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285442    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285447    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285450    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285453    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285456    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285459    2569 flags.go:64] FLAG: --enable-server="true"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285462    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285467    2569 flags.go:64] FLAG: --event-burst="100"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285469    2569 flags.go:64] FLAG: --event-qps="50"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285472    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285476    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285478    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285483    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285485    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285488    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285491    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285494    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285497    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285500    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285503    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285506    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285509    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285547    2569 flags.go:64] FLAG: --feature-gates=""
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285560    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 17:39:06.529126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285565    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285568    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285572    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285575    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285578    2569 flags.go:64] FLAG: --help="false"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285581    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285585    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285588    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285591    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285594    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285598    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285600    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285603    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285606    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285609    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285612    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285616    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285618    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285621    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285624    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285627    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285630    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285633    2569 flags.go:64] FLAG: --lock-file=""
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285635    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 17:39:06.529847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285638    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285642    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285648    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285650    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285654    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285656    2569 flags.go:64] FLAG: --logging-format="text"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285659    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285663    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285667    2569 flags.go:64] FLAG: --manifest-url=""
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285670    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285675    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285678    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285682    2569 flags.go:64] FLAG: --max-pods="110"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285685    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285690    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285693    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285696    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285699    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285702    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285705    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285713    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285716    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285719    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 17:39:06.530515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285722    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285725    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285732    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285735    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285738    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285741    2569 flags.go:64] FLAG: --port="10250"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285745    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285748    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aab536f071729c39"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285751    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285754    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285757    2569 flags.go:64] FLAG: --register-node="true"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285760    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285764    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285767    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285769    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285773    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285777    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285780    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285785    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285788    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285791    2569 flags.go:64] FLAG: --runonce="false"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285793    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285797    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285801    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285803    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 17:39:06.531151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285806    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285809    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285812    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285815    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285818    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285821    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285824    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285826    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285830    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285832    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285835    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285841    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285843    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285846    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285850    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285853    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285856    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285859    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285862    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285865    2569 flags.go:64] FLAG: --v="2"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285870    2569 flags.go:64] FLAG: --version="false"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285874    2569 flags.go:64] FLAG: --vmodule=""
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285878    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.285881    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286002    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:39:06.531865 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286008    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286011    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286014    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286018    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286020    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286025    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286027    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286030    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286033    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286036    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286038    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286041    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286043    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286046    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286048    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286051    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286053    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286056    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286058    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286061    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:39:06.535113 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286063    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286066    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286068    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286071    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286074    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286076    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286079    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286081    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286083    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286087    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286089    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286091    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286096    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286099    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286102    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286105    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286108    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286112    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286114    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:39:06.535718 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286117    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286119    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286123    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286127    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286130    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286133    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286135    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286138    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286140    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286143    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286145    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286148    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286150    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286153    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286155    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286158    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286160    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286163    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286165    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:39:06.643191 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286168    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286170    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286173    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286175    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286178    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286180    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286184    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286187    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286191    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286194    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286196    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286200    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286202    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286205    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286208    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286210    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286213    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286215    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286217    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286220    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:39:06.643883 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286222    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286225    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286227    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286230    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286234    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286238    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286242    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286245    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286248    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286251    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286254    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286258    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286261    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286263    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286266    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286269    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286272    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286274    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286279    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:39:06.644475 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.286282    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.286952    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.298278    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.298300    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.298318    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.298324    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298389    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298394    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298398    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298401    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298405    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298408    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298411    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298414    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298417    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:39:06.645063 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298420    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298423    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298426    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298429    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298432    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298435    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298437    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298440    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298443    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298446    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298448    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298451    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298453    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298456    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298459    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298462    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298465    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298468    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298472    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:39:06.645493 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298476    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298480    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298483    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298486    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298494    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298497    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298500    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298503    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298506    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298508    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298511    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298514    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298517    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298520    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298540    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298544    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298547    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298550    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298553    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:39:06.646136 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298556    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298560    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298562    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298565    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298567    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298570    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298572    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298575    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298578    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298580    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298583    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298586    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298588    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298591    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298593    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298596    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298599    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298603    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298606    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298609    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:39:06.646672 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298612    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298614    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298617    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298619    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298622    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298625    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298628    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298630    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298633    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298637    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298641    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298644    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298647    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298650    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298653    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298655    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298658    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298660    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298663    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298665    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:39:06.647236 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298668    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298672    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298675    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298678    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298681    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298683    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298686    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298688    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298691    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298694    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298697    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298700    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.298706    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298830    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298836    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:39:06.647786 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298839    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298842    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298845    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298848    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298851    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298854    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298857    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298860    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298863    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298866    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298869    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298872    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298874    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298877    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298880    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298882    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298885    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298888    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298890    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298895    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:39:06.648269 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298898    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298900    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298903    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298905    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298908    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298911    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298915    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298918    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298920    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298923    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298925    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298928    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298930    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298933    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298935    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298938    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298940    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298943    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298945    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298948    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:39:06.648857 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298951    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298954    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298957    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298960    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298963    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298965    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298968    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298970    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298973    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298975    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298978    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298983    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298986    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298990    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298994    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.298997    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299000    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299003    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299006    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299009    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:39:06.649419 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299012    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299015    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299019    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299022    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299024    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299027    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299030    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299033    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299036    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299039    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299041    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299044    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299048    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299051    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299054    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299056    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299059    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299062    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299065    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299067    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:39:06.649976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299070    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299072    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299074    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299078    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299081    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299083    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299085    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299088    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299090    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299093    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299097    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299099    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299102    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299104    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299109    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299112    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:39:06.650586 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:06.299115    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.299120    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.299265    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.302494    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.304266    2569 server.go:1019] "Starting client certificate rotation"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.304379    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.304416    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.307485    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.308896    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.319473    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.323575    2569 log.go:25] "Validated CRI v1 image API"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.325266    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 17:39:06.651030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.328546    2569 fs.go:135] Filesystem UUIDs: map[3880e738-be10-4dc2-936b-ee619bef9af5:/dev/nvme0n1p4 497843a9-eedb-4fdb-b98f-f5ab77d38d85:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 17:39:06.651417 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.328568    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.336868    2569 manager.go:216] Machine: {Timestamp:2026-07-09 17:39:06.334169646 +0000 UTC m=+0.379466149 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100312 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d3cec9894160e68f04d0f5f21628 SystemUUID:ec22d3ce-c989-4160-e68f-04d0f5f21628 BootID:3249a97b-5494-4d44-aa96-76a66547a3b9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:ff:06:00:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:ff:06:00:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:47:a2:8b:1d:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.337000    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.337115    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.338682    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.338722    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.339874    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.339889    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 17:39:06.651485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.339899    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.340783    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.342377    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.345693    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.345848    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.346612    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.346628    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.346646    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.346656    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.346666    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.347086    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.347102    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.349599    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352226    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352256    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352457    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352475    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352483    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352489    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352497    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.352503    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.353061    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.353072    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.353079    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.353086    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.353095    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.353104    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.354710    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.354720    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.356052    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.357409    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.357421    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.357485    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.358346    2569 server.go:1268] "Started kubelet"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.358416    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.358439    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.358519    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.360057    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 17:39:06.651878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.361435    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.363835    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-118.ec2.internal.18c0afccbf6a3a1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-118.ec2.internal,UID:ip-10-0-141-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-118.ec2.internal,},FirstTimestamp:2026-07-09 17:39:06.358315549 +0000 UTC m=+0.403612051,LastTimestamp:2026-07-09 17:39:06.358315549 +0000 UTC m=+0.403612051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-118.ec2.internal,}"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.365302    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.368088    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.368106    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.368175    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.368801    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.368804    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.368822    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369512    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369541    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369628    2569 factory.go:153] Registering CRI-O factory
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369641    2569 factory.go:223] Registration of the crio container factory successfully
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369693    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369709    2569 factory.go:55] Registering systemd factory
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369717    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369739    2569 factory.go:103] Registering Raw factory
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.369753    2569 manager.go:1196] Started watching for new ooms in manager
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.370288    2569 manager.go:349] Starting recovery of all containers
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.380729    2569 manager.go:354] Recovery completed
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.382341    2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.382437    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.382474    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.385911    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.388044    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.388082    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.388095    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.388642    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.388656    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.388659    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.388674    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.389449    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:06.653078 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.389477    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.389512    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.389743    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-118.ec2.internal.18c0afccc130207c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-118.ec2.internal,UID:ip-10-0-141-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-118.ec2.internal,},FirstTimestamp:2026-07-09 17:39:06.388062332 +0000 UTC m=+0.433358838,LastTimestamp:2026-07-09 17:39:06.388062332 +0000 UTC m=+0.433358838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-118.ec2.internal,}"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.389869    2569 policy_none.go:49] "None policy: Start"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.389888    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.389903    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.390854    2569 policy_none.go:47] "Start"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.396542    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j8xhs"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.401321    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-118.ec2.internal.18c0afccc130857c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-118.ec2.internal,UID:ip-10-0-141-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-118.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-118.ec2.internal,},FirstTimestamp:2026-07-09 17:39:06.388088188 +0000 UTC m=+0.433384690,LastTimestamp:2026-07-09 17:39:06.388088188 +0000 UTC m=+0.433384690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-118.ec2.internal,}"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.405472    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j8xhs"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.436311    2569 manager.go:337] "Starting Device Plugin manager"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.436352    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.436363    2569 server.go:87] "Starting device plugin registration server"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.436656    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.436668    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.436781    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.436861    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.436870    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.437299    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.437347    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.492242    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.493453    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.493487    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.493512    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.493565    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.496725    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.536988    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:06.654166 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.538181    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.538216    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.538231    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.538257    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.547842    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.547869    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-118.ec2.internal\": node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.581258    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.594245    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal"]
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.594320    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.595963    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.595991    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.596000    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.597451    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.597580    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.597615    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.598312    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.598338    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.598348    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.598314    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.598415    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.598428    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.599630    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.599653    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.600373    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.600396    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.600408    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.624318    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-118.ec2.internal\" not found" node="ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.627970    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-118.ec2.internal\" not found" node="ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.815215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.672055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a090b1eff3820c7ae8f86d37c5d4bd56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal\" (UID: \"a090b1eff3820c7ae8f86d37c5d4bd56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.672092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a090b1eff3820c7ae8f86d37c5d4bd56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal\" (UID: \"a090b1eff3820c7ae8f86d37c5d4bd56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.672110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c36f7378c668aa82a44a3b3d0710dfe6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-118.ec2.internal\" (UID: \"c36f7378c668aa82a44a3b3d0710dfe6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.681851    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.772881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a090b1eff3820c7ae8f86d37c5d4bd56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal\" (UID: \"a090b1eff3820c7ae8f86d37c5d4bd56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.772918    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a090b1eff3820c7ae8f86d37c5d4bd56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal\" (UID: \"a090b1eff3820c7ae8f86d37c5d4bd56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.772936    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c36f7378c668aa82a44a3b3d0710dfe6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-118.ec2.internal\" (UID: \"c36f7378c668aa82a44a3b3d0710dfe6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.772986    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a090b1eff3820c7ae8f86d37c5d4bd56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal\" (UID: \"a090b1eff3820c7ae8f86d37c5d4bd56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.773012    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c36f7378c668aa82a44a3b3d0710dfe6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-118.ec2.internal\" (UID: \"c36f7378c668aa82a44a3b3d0710dfe6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.772989    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a090b1eff3820c7ae8f86d37c5d4bd56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal\" (UID: \"a090b1eff3820c7ae8f86d37c5d4bd56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.816245 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.781920    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:06.953399 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:06.882804    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:06.953399 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.925995    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:06.953399 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:06.930740    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:07.217011 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:07.163938    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:07.339495 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:07.264502    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:07.339495 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.303034    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 17:39:07.339495 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.303214    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 17:39:07.500846 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:07.364728    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:07.500846 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.378374    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:39:07.500846 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.409889    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 17:34:07 +0000 UTC" deadline="2028-02-29 14:54:45.963322071 +0000 UTC"
Jul 09 17:39:07.500846 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.409925    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14397h15m38.553401153s"
Jul 09 17:39:07.500846 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:07.464856    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:07.630209 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.530744    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:39:07.630209 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:07.565663    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:07.756909 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:07.666100    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-118.ec2.internal\" not found"
Jul 09 17:39:07.756909 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.698165    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:39:07.756909 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.698193    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:39:07.756909 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.698205    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:39:07.756909 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.751450    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:39:07.769056 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.768268    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:07.891185 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.829449    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 17:39:07.891185 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.830902    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal"
Jul 09 17:39:08.037762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.966297    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 17:39:08.037762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:07.968182    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.347753    2569 apiserver.go:52] "Watching apiserver"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.354236    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.354744    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-sc5lg","kube-system/konnectivity-agent-bpw6z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v","openshift-dns/node-resolver-z9spw","openshift-image-registry/node-ca-hdxkr","openshift-multus/multus-additional-cni-plugins-qgsxj","openshift-multus/multus-jv2d4","openshift-network-diagnostics/network-check-target-whhxk","kube-system/global-pull-secret-syncer-bzwv4","kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nzwg4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal","openshift-multus/network-metrics-daemon-ggjz7","openshift-network-operator/iptables-alerter-b7cc9"]
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.369362    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-k8s-cni-cncf-io\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-hostroot\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7zp6\" (UniqueName: \"kubernetes.io/projected/b1dff61c-89a0-415f-91a5-426707f4110d-kube-api-access-b7zp6\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-cni-multus\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-system-cni-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373847    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-os-release\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-cni-binary-copy\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-netns\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-conf-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.373972    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-etc-kubernetes\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.431632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.374000    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-cni-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.374038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-kubelet\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.374061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-cni-bin\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.374079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-cnibin\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.374096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-socket-dir-parent\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.374112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-multus-daemon-config\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.374139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-multus-certs\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.406949    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.433651    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpnb7"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.443257    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpnb7"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-cni-multus\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-system-cni-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-os-release\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-cni-binary-copy\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474788    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-netns\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474821    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-cni-multus\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.551272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474850    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-netns\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-conf-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474872    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-os-release\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474896    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-etc-kubernetes\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474902    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-conf-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-cni-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474920    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-system-cni-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-etc-kubernetes\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-kubelet\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-cni-bin\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474982    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-kubelet\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.474994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-cnibin\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-socket-dir-parent\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475029    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-var-lib-cni-bin\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.475038    2569 configmap.go:193] Couldn't get configMap openshift-multus/cni-copy-resources: object "openshift-multus"/"cni-copy-resources" not registered
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475053    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-cnibin\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.552800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-multus-daemon-config\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.475097    2569 configmap.go:193] Couldn't get configMap openshift-multus/multus-daemon-config: object "openshift-multus"/"multus-daemon-config" not registered
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.475126    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-cni-binary-copy podName:b1dff61c-89a0-415f-91a5-426707f4110d nodeName:}" failed. No retries permitted until 2026-07-09 17:39:08.975101148 +0000 UTC m=+3.020397638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cni-binary-copy" (UniqueName: "kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-cni-binary-copy") pod "multus-jv2d4" (UID: "b1dff61c-89a0-415f-91a5-426707f4110d") : object "openshift-multus"/"cni-copy-resources" not registered
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475140    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-socket-dir-parent\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.475152    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-multus-daemon-config podName:b1dff61c-89a0-415f-91a5-426707f4110d nodeName:}" failed. No retries permitted until 2026-07-09 17:39:08.975145363 +0000 UTC m=+3.020441853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "multus-daemon-config" (UniqueName: "kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-multus-daemon-config") pod "multus-jv2d4" (UID: "b1dff61c-89a0-415f-91a5-426707f4110d") : object "openshift-multus"/"multus-daemon-config" not registered
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475141    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-multus-cni-dir\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-multus-certs\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-k8s-cni-cncf-io\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475223    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-hostroot\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475224    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-multus-certs\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475248    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7zp6\" (UniqueName: \"kubernetes.io/projected/b1dff61c-89a0-415f-91a5-426707f4110d-kube-api-access-b7zp6\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475255    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-hostroot\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.475258    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1dff61c-89a0-415f-91a5-426707f4110d-host-run-k8s-cni-cncf-io\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.486021    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.488477    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.488614    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.488652    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s7zhl\""
Jul 09 17:39:08.553452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.488656    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.488656    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.488721    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.490087    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.493035    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.495154    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.495211    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.495213    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.495502    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cfpk7\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.495745    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.497852    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.497931    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.498219    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.498268    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d2bzg\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.499646    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.500018    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.500028    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.500442    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.500493    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z55rt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.500758    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.501831    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.502113    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.502337    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f4j8k\""
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.503164    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.503244    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.505723    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.506846    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7zp6\" (UniqueName: \"kubernetes.io/projected/b1dff61c-89a0-415f-91a5-426707f4110d-kube-api-access-b7zp6\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.554799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.507744    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.507744    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.507779    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q565w\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.507918    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.507921    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.508230    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.508231    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.508643    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.510341    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.510386    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4cmgp\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.510435    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.511388    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.513353    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.513356    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.513678    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.514181    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z2k6w\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.514212    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.515659    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qn497\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.515915    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.515915    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.516324    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:08.555735 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.516395    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:08.570019 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.569990    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 17:39:08.575842 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.575813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-modprobe-d\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.575913 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.575849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-tuned\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.575913 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.575876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-registration-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.575913 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.575901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9mls\" (UniqueName: \"kubernetes.io/projected/1db691a5-cf23-4aa4-8852-52441b0aa37a-kube-api-access-r9mls\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.576105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.575938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-etc-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.575982    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-node-log\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-cni-netd\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-ovnkube-config\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c168d2cf-0c73-4d53-b6f7-c90175455360-agent-certs\") pod \"konnectivity-agent-bpw6z\" (UID: \"c168d2cf-0c73-4d53-b6f7-c90175455360\") " pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.576105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576087    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-sys\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.576105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-device-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-env-overrides\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-kubernetes\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576194    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/caf69956-4806-45a0-8f7e-e61a98441332-hosts-file\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576212    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysctl-conf\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-sys-fs\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-log-socket\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhtt\" (UniqueName: \"kubernetes.io/projected/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-kube-api-access-lzhtt\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576345    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-slash\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576371 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-ovn\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576379    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-system-cni-dir\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-kubelet\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576431    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-systemd-units\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-var-lib-kubelet\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-host\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-systemd\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576578    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysctl-d\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-run-netns\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.576815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576671    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8ck\" (UniqueName: \"kubernetes.io/projected/2e8195f6-2749-44b3-ab58-dfb07e57b84c-kube-api-access-7l8ck\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30b8805a-d5a8-4a0f-8334-96625dd051b1-kubelet-config\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-var-lib-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576785    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-run-ovn-kubernetes\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8b46a38-bde5-4704-b15f-f4580a161033-host-slash\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e27f024-165e-4c54-899e-d2c111f4afa6-tmp\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-cni-bin\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txljp\" (UniqueName: \"kubernetes.io/projected/b8b46a38-bde5-4704-b15f-f4580a161033-kube-api-access-txljp\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-socket-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576943    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hqd8\" (UniqueName: \"kubernetes.io/projected/caf69956-4806-45a0-8f7e-e61a98441332-kube-api-access-2hqd8\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.577311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576960    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-serviceca\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.576977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cnibin\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8b46a38-bde5-4704-b15f-f4580a161033-iptables-alerter-script\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-systemd\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-run\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577099    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58ltb\" (UniqueName: \"kubernetes.io/projected/2e27f024-165e-4c54-899e-d2c111f4afa6-kube-api-access-58ltb\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577121    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577143    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqrs6\" (UniqueName: \"kubernetes.io/projected/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-kube-api-access-sqrs6\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577173    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-lib-modules\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-host\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577215    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30b8805a-d5a8-4a0f-8334-96625dd051b1-dbus\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87ca8c12-18c1-42cf-939b-d23596f4e426-ovn-node-metrics-cert\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.577818 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577299    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxkrp\" (UniqueName: \"kubernetes.io/projected/87ca8c12-18c1-42cf-939b-d23596f4e426-kube-api-access-gxkrp\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.578353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577351    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.578353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-ovnkube-script-lib\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.578353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysconfig\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.578353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577417    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf69956-4806-45a0-8f7e-e61a98441332-tmp-dir\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.578353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-os-release\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.578353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.577460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c168d2cf-0c73-4d53-b6f7-c90175455360-konnectivity-ca\") pod \"konnectivity-agent-bpw6z\" (UID: \"c168d2cf-0c73-4d53-b6f7-c90175455360\") " pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.677853 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.677812    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-kubernetes\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.677995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.677865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/caf69956-4806-45a0-8f7e-e61a98441332-hosts-file\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.677995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.677914    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.677995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.677946    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/caf69956-4806-45a0-8f7e-e61a98441332-hosts-file\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.677995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.677960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysctl-conf\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.677995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.677987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-sys-fs\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.677995    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-kubernetes\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678014    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-log-socket\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678040    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhtt\" (UniqueName: \"kubernetes.io/projected/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-kube-api-access-lzhtt\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678067    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-slash\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678081    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-sys-fs\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678095    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-ovn\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-system-cni-dir\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678139    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysctl-conf\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-kubelet\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678102    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-log-socket\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-systemd-units\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-kubelet\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-var-lib-kubelet\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-ovn\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.678260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678238    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-system-cni-dir\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-host\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678275    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-host\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678287    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-slash\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678325    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-systemd-units\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678376    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-var-lib-kubelet\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-systemd\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678479    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-systemd\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678515    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.678530    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysctl-d\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678583    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.679043 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678586    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.678616    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:39:09.178580132 +0000 UTC m=+3.223876629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-run-netns\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8ck\" (UniqueName: \"kubernetes.io/projected/2e8195f6-2749-44b3-ab58-dfb07e57b84c-kube-api-access-7l8ck\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.678694    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.678744    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret podName:30b8805a-d5a8-4a0f-8334-96625dd051b1 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:09.178732791 +0000 UTC m=+3.224029282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret") pod "global-pull-secret-syncer-bzwv4" (UID: "30b8805a-d5a8-4a0f-8334-96625dd051b1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678757    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysctl-d\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678760    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30b8805a-d5a8-4a0f-8334-96625dd051b1-kubelet-config\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-var-lib-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-run-ovn-kubernetes\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.679934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-run-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678877    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678887    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8b46a38-bde5-4704-b15f-f4580a161033-host-slash\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678914    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e27f024-165e-4c54-899e-d2c111f4afa6-tmp\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678963    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678982    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-run-netns\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.678994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-cni-bin\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679044    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-cni-bin\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txljp\" (UniqueName: \"kubernetes.io/projected/b8b46a38-bde5-4704-b15f-f4580a161033-kube-api-access-txljp\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-socket-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679105    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-var-lib-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-run-ovn-kubernetes\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679163    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hqd8\" (UniqueName: \"kubernetes.io/projected/caf69956-4806-45a0-8f7e-e61a98441332-kube-api-access-2hqd8\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679223    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.680640 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679234    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679196    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-serviceca\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cnibin\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8b46a38-bde5-4704-b15f-f4580a161033-iptables-alerter-script\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679362    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-socket-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-systemd\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-run\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679436    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8b46a38-bde5-4704-b15f-f4580a161033-host-slash\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58ltb\" (UniqueName: \"kubernetes.io/projected/2e27f024-165e-4c54-899e-d2c111f4afa6-kube-api-access-58ltb\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679479    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679510    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrs6\" (UniqueName: \"kubernetes.io/projected/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-kube-api-access-sqrs6\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679541    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-lib-modules\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-host\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30b8805a-d5a8-4a0f-8334-96625dd051b1-dbus\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.681393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679719    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-serviceca\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679779    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-host\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87ca8c12-18c1-42cf-939b-d23596f4e426-ovn-node-metrics-cert\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxkrp\" (UniqueName: \"kubernetes.io/projected/87ca8c12-18c1-42cf-939b-d23596f4e426-kube-api-access-gxkrp\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679879    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-lib-modules\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679934    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30b8805a-d5a8-4a0f-8334-96625dd051b1-kubelet-config\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.679721    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-cnibin\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680005    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30b8805a-d5a8-4a0f-8334-96625dd051b1-dbus\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680027    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680062    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-ovnkube-script-lib\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680095    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysconfig\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf69956-4806-45a0-8f7e-e61a98441332-tmp-dir\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.682024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680157    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-os-release\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c168d2cf-0c73-4d53-b6f7-c90175455360-konnectivity-ca\") pod \"konnectivity-agent-bpw6z\" (UID: \"c168d2cf-0c73-4d53-b6f7-c90175455360\") " pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680224    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-modprobe-d\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680248    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-run\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-tuned\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680295    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-registration-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9mls\" (UniqueName: \"kubernetes.io/projected/1db691a5-cf23-4aa4-8852-52441b0aa37a-kube-api-access-r9mls\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-etc-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680360    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8b46a38-bde5-4704-b15f-f4580a161033-iptables-alerter-script\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680378    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-node-log\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-cni-netd\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680431    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-ovnkube-config\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c168d2cf-0c73-4d53-b6f7-c90175455360-agent-certs\") pod \"konnectivity-agent-bpw6z\" (UID: \"c168d2cf-0c73-4d53-b6f7-c90175455360\") " pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-sys\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.682579 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-device-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-env-overrides\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680588    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-node-log\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680669    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-registration-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680684    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680777    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-os-release\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680096    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-systemd\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680917    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-etc-openvswitch\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681022    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-ovnkube-script-lib\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681072    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf69956-4806-45a0-8f7e-e61a98441332-tmp-dir\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681146    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87ca8c12-18c1-42cf-939b-d23596f4e426-host-cni-netd\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681201    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-sys\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681249    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1db691a5-cf23-4aa4-8852-52441b0aa37a-device-dir\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681671    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-ovnkube-config\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.680157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-sysconfig\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.683105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681819    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c168d2cf-0c73-4d53-b6f7-c90175455360-konnectivity-ca\") pod \"konnectivity-agent-bpw6z\" (UID: \"c168d2cf-0c73-4d53-b6f7-c90175455360\") " pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.683613 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.681827    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-modprobe-d\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.683613 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.682106    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87ca8c12-18c1-42cf-939b-d23596f4e426-env-overrides\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683613 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.682469    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e27f024-165e-4c54-899e-d2c111f4afa6-tmp\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.683613 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.682551    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e27f024-165e-4c54-899e-d2c111f4afa6-etc-tuned\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.683613 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.682945    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87ca8c12-18c1-42cf-939b-d23596f4e426-ovn-node-metrics-cert\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.683613 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.683439    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c168d2cf-0c73-4d53-b6f7-c90175455360-agent-certs\") pod \"konnectivity-agent-bpw6z\" (UID: \"c168d2cf-0c73-4d53-b6f7-c90175455360\") " pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.687809 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.687776    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhtt\" (UniqueName: \"kubernetes.io/projected/f8dc5e42-1b09-432e-827b-bd8ab962b3b4-kube-api-access-lzhtt\") pod \"node-ca-hdxkr\" (UID: \"f8dc5e42-1b09-432e-827b-bd8ab962b3b4\") " pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.690428 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.690408    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8ck\" (UniqueName: \"kubernetes.io/projected/2e8195f6-2749-44b3-ab58-dfb07e57b84c-kube-api-access-7l8ck\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:08.693116 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.693095    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:08.697070 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.697035    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:39:08.697070 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.697063    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:39:08.697254 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.697077    2569 projected.go:196] Error preparing data for projected volume kube-api-access-7qhqt for pod openshift-network-diagnostics/network-check-target-whhxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:08.697254 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:08.697160    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt podName:da37e445-bddb-4fe7-80ce-d4795c0c2042 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:09.197137041 +0000 UTC m=+3.242433555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7qhqt" (UniqueName: "kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt") pod "network-check-target-whhxk" (UID: "da37e445-bddb-4fe7-80ce-d4795c0c2042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:08.697381 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.697279    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txljp\" (UniqueName: \"kubernetes.io/projected/b8b46a38-bde5-4704-b15f-f4580a161033-kube-api-access-txljp\") pod \"iptables-alerter-b7cc9\" (UID: \"b8b46a38-bde5-4704-b15f-f4580a161033\") " pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.697484 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.697456    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ltb\" (UniqueName: \"kubernetes.io/projected/2e27f024-165e-4c54-899e-d2c111f4afa6-kube-api-access-58ltb\") pod \"tuned-nzwg4\" (UID: \"2e27f024-165e-4c54-899e-d2c111f4afa6\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.697595 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.697560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9mls\" (UniqueName: \"kubernetes.io/projected/1db691a5-cf23-4aa4-8852-52441b0aa37a-kube-api-access-r9mls\") pod \"aws-ebs-csi-driver-node-mkx4v\" (UID: \"1db691a5-cf23-4aa4-8852-52441b0aa37a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.697913 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.697889    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hqd8\" (UniqueName: \"kubernetes.io/projected/caf69956-4806-45a0-8f7e-e61a98441332-kube-api-access-2hqd8\") pod \"node-resolver-z9spw\" (UID: \"caf69956-4806-45a0-8f7e-e61a98441332\") " pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.698242 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.698222    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqrs6\" (UniqueName: \"kubernetes.io/projected/279c3e22-e5e1-4049-b242-9b3fa3ab38c0-kube-api-access-sqrs6\") pod \"multus-additional-cni-plugins-qgsxj\" (UID: \"279c3e22-e5e1-4049-b242-9b3fa3ab38c0\") " pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.699442 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.699420    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxkrp\" (UniqueName: \"kubernetes.io/projected/87ca8c12-18c1-42cf-939b-d23596f4e426-kube-api-access-gxkrp\") pod \"ovnkube-node-sc5lg\" (UID: \"87ca8c12-18c1-42cf-939b-d23596f4e426\") " pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.713504 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.713469    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7cc9"
Jul 09 17:39:08.715441 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.715404    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36f7378c668aa82a44a3b3d0710dfe6.slice/crio-3cf54b794d286664c0ec28cf00bdf93d97e71be69f91bb9679610274965d5498 WatchSource:0}: Error finding container 3cf54b794d286664c0ec28cf00bdf93d97e71be69f91bb9679610274965d5498: Status 404 returned error can't find the container with id 3cf54b794d286664c0ec28cf00bdf93d97e71be69f91bb9679610274965d5498
Jul 09 17:39:08.720624 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.720575    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc168d2cf_0c73_4d53_b6f7_c90175455360.slice/crio-d02cd03cb302f4c2b7a60858c49e45abe8f66eeba8d5968423f2a32896168f4d WatchSource:0}: Error finding container d02cd03cb302f4c2b7a60858c49e45abe8f66eeba8d5968423f2a32896168f4d: Status 404 returned error can't find the container with id d02cd03cb302f4c2b7a60858c49e45abe8f66eeba8d5968423f2a32896168f4d
Jul 09 17:39:08.722271 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.722250    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:39:08.723332 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.723302    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda090b1eff3820c7ae8f86d37c5d4bd56.slice/crio-b7046eae1d0d5ab73129e06ad7bd4307b1cbf88b86a1bb85fe4fd2928d153e92 WatchSource:0}: Error finding container b7046eae1d0d5ab73129e06ad7bd4307b1cbf88b86a1bb85fe4fd2928d153e92: Status 404 returned error can't find the container with id b7046eae1d0d5ab73129e06ad7bd4307b1cbf88b86a1bb85fe4fd2928d153e92
Jul 09 17:39:08.726953 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.726927    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b46a38_bde5_4704_b15f_f4580a161033.slice/crio-3c099b061d205fcd95449c0375b72afcbc65646b92a6418edf3f42aa4d2d7a44 WatchSource:0}: Error finding container 3c099b061d205fcd95449c0375b72afcbc65646b92a6418edf3f42aa4d2d7a44: Status 404 returned error can't find the container with id 3c099b061d205fcd95449c0375b72afcbc65646b92a6418edf3f42aa4d2d7a44
Jul 09 17:39:08.738705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.738676    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzwg4"
Jul 09 17:39:08.749684 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.749655    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e27f024_165e_4c54_899e_d2c111f4afa6.slice/crio-58bc38556b4408f0c61572a0344506c0a6a19e83f8567cd988d328899097d441 WatchSource:0}: Error finding container 58bc38556b4408f0c61572a0344506c0a6a19e83f8567cd988d328899097d441: Status 404 returned error can't find the container with id 58bc38556b4408f0c61572a0344506c0a6a19e83f8567cd988d328899097d441
Jul 09 17:39:08.850437 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.850403    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:39:08.863514 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.863475    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v"
Jul 09 17:39:08.874497 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.874469    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db691a5_cf23_4aa4_8852_52441b0aa37a.slice/crio-1978fd876e19a7685103e9445b15c54e1f32af536247bdd0dbf92878032c68d4 WatchSource:0}: Error finding container 1978fd876e19a7685103e9445b15c54e1f32af536247bdd0dbf92878032c68d4: Status 404 returned error can't find the container with id 1978fd876e19a7685103e9445b15c54e1f32af536247bdd0dbf92878032c68d4
Jul 09 17:39:08.940741 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.940637    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9spw"
Jul 09 17:39:08.949919 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.949891    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf69956_4806_45a0_8f7e_e61a98441332.slice/crio-c6ba9c9ad158d49c0ae0daba584a4f3fa9cd8e5b9ea9bb145b12e45c49a8f090 WatchSource:0}: Error finding container c6ba9c9ad158d49c0ae0daba584a4f3fa9cd8e5b9ea9bb145b12e45c49a8f090: Status 404 returned error can't find the container with id c6ba9c9ad158d49c0ae0daba584a4f3fa9cd8e5b9ea9bb145b12e45c49a8f090
Jul 09 17:39:08.954375 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.954354    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdxkr"
Jul 09 17:39:08.964629 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.964586    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8dc5e42_1b09_432e_827b_bd8ab962b3b4.slice/crio-7bd18d8be689d03b040b922468a7b55eda7c8cd8c2435f3e3ed545c357473d4f WatchSource:0}: Error finding container 7bd18d8be689d03b040b922468a7b55eda7c8cd8c2435f3e3ed545c357473d4f: Status 404 returned error can't find the container with id 7bd18d8be689d03b040b922468a7b55eda7c8cd8c2435f3e3ed545c357473d4f
Jul 09 17:39:08.970758 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.970729    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qgsxj"
Jul 09 17:39:08.977308 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.977277    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:08.980626 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.980465    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279c3e22_e5e1_4049_b242_9b3fa3ab38c0.slice/crio-cc68759c8fb2e5e0bdc668cf1861aef0308f3e3b4056a69cdd2ce721ec6a169c WatchSource:0}: Error finding container cc68759c8fb2e5e0bdc668cf1861aef0308f3e3b4056a69cdd2ce721ec6a169c: Status 404 returned error can't find the container with id cc68759c8fb2e5e0bdc668cf1861aef0308f3e3b4056a69cdd2ce721ec6a169c
Jul 09 17:39:08.983227 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.983202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-cni-binary-copy\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.983324 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.983255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-multus-daemon-config\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.983868 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.983844    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-multus-daemon-config\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.983976 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:08.983844    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1dff61c-89a0-415f-91a5-426707f4110d-cni-binary-copy\") pod \"multus-jv2d4\" (UID: \"b1dff61c-89a0-415f-91a5-426707f4110d\") " pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:08.987125 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:08.987097    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ca8c12_18c1_42cf_939b_d23596f4e426.slice/crio-172b4c7bfd1d07ad46540536a67c665d29a8bc6f65fe0a964bcbf331c0505d3b WatchSource:0}: Error finding container 172b4c7bfd1d07ad46540536a67c665d29a8bc6f65fe0a964bcbf331c0505d3b: Status 404 returned error can't find the container with id 172b4c7bfd1d07ad46540536a67c665d29a8bc6f65fe0a964bcbf331c0505d3b
Jul 09 17:39:09.140857 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.140815    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jv2d4"
Jul 09 17:39:09.186325 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.186004    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:09.186325 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.186061    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:09.186325 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.186261    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:09.186325 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.186274    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:09.186769 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.186341    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:39:10.186319352 +0000 UTC m=+4.231615846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:09.186769 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.186363    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret podName:30b8805a-d5a8-4a0f-8334-96625dd051b1 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:10.186352131 +0000 UTC m=+4.231648621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret") pod "global-pull-secret-syncer-bzwv4" (UID: "30b8805a-d5a8-4a0f-8334-96625dd051b1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:09.287335 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.286579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:09.287335 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.286794    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:39:09.287335 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.286816    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:39:09.287335 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.286830    2569 projected.go:196] Error preparing data for projected volume kube-api-access-7qhqt for pod openshift-network-diagnostics/network-check-target-whhxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:09.287335 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:09.286893    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt podName:da37e445-bddb-4fe7-80ce-d4795c0c2042 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:10.286873271 +0000 UTC m=+4.332169767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qhqt" (UniqueName: "kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt") pod "network-check-target-whhxk" (UID: "da37e445-bddb-4fe7-80ce-d4795c0c2042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:09.485832 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.485739    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:34:09 +0000 UTC" deadline="2028-03-10 10:43:53.541294065 +0000 UTC"
Jul 09 17:39:09.485832 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.485828    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14633h4m44.055471218s"
Jul 09 17:39:09.725630 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.714483    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzwg4" event={"ID":"2e27f024-165e-4c54-899e-d2c111f4afa6","Type":"ContainerStarted","Data":"58bc38556b4408f0c61572a0344506c0a6a19e83f8567cd988d328899097d441"}
Jul 09 17:39:09.732529 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.732431    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7cc9" event={"ID":"b8b46a38-bde5-4704-b15f-f4580a161033","Type":"ContainerStarted","Data":"3c099b061d205fcd95449c0375b72afcbc65646b92a6418edf3f42aa4d2d7a44"}
Jul 09 17:39:09.756012 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.755966    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal" event={"ID":"a090b1eff3820c7ae8f86d37c5d4bd56","Type":"ContainerStarted","Data":"b7046eae1d0d5ab73129e06ad7bd4307b1cbf88b86a1bb85fe4fd2928d153e92"}
Jul 09 17:39:09.772099 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.772024    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal" event={"ID":"c36f7378c668aa82a44a3b3d0710dfe6","Type":"ContainerStarted","Data":"3cf54b794d286664c0ec28cf00bdf93d97e71be69f91bb9679610274965d5498"}
Jul 09 17:39:09.791210 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.791168    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jv2d4" event={"ID":"b1dff61c-89a0-415f-91a5-426707f4110d","Type":"ContainerStarted","Data":"8f4d63481cde88196dd46d69b125baabfaf098463411f1f658aead06b9a070f8"}
Jul 09 17:39:09.821307 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.821152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"172b4c7bfd1d07ad46540536a67c665d29a8bc6f65fe0a964bcbf331c0505d3b"}
Jul 09 17:39:09.845624 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.845505    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdxkr" event={"ID":"f8dc5e42-1b09-432e-827b-bd8ab962b3b4","Type":"ContainerStarted","Data":"7bd18d8be689d03b040b922468a7b55eda7c8cd8c2435f3e3ed545c357473d4f"}
Jul 09 17:39:09.873685 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.873584    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9spw" event={"ID":"caf69956-4806-45a0-8f7e-e61a98441332","Type":"ContainerStarted","Data":"c6ba9c9ad158d49c0ae0daba584a4f3fa9cd8e5b9ea9bb145b12e45c49a8f090"}
Jul 09 17:39:09.896342 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.896301    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bpw6z" event={"ID":"c168d2cf-0c73-4d53-b6f7-c90175455360","Type":"ContainerStarted","Data":"d02cd03cb302f4c2b7a60858c49e45abe8f66eeba8d5968423f2a32896168f4d"}
Jul 09 17:39:09.919452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.919349    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerStarted","Data":"cc68759c8fb2e5e0bdc668cf1861aef0308f3e3b4056a69cdd2ce721ec6a169c"}
Jul 09 17:39:09.940852 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:09.940805    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v" event={"ID":"1db691a5-cf23-4aa4-8852-52441b0aa37a","Type":"ContainerStarted","Data":"1978fd876e19a7685103e9445b15c54e1f32af536247bdd0dbf92878032c68d4"}
Jul 09 17:39:10.194677 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.194627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:10.194908 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.194693    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:10.194908 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.194882    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:10.195029 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.194953    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret podName:30b8805a-d5a8-4a0f-8334-96625dd051b1 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:12.194932024 +0000 UTC m=+6.240228519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret") pod "global-pull-secret-syncer-bzwv4" (UID: "30b8805a-d5a8-4a0f-8334-96625dd051b1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:10.195460 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.195436    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:10.195571 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.195503    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:39:12.195484583 +0000 UTC m=+6.240781089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:10.296030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.295988    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:10.296269 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.296216    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:39:10.296269 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.296248    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:39:10.296269 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.296263    2569 projected.go:196] Error preparing data for projected volume kube-api-access-7qhqt for pod openshift-network-diagnostics/network-check-target-whhxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:10.296449 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.296330    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt podName:da37e445-bddb-4fe7-80ce-d4795c0c2042 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:12.296309429 +0000 UTC m=+6.341605925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qhqt" (UniqueName: "kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt") pod "network-check-target-whhxk" (UID: "da37e445-bddb-4fe7-80ce-d4795c0c2042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:10.486697 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.486582    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:34:09 +0000 UTC" deadline="2028-01-13 16:48:43.00191047 +0000 UTC"
Jul 09 17:39:10.486697 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.486630    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13271h9m32.51528545s"
Jul 09 17:39:10.497294 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.497233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:10.497496 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.497435    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:10.497902 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.497753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:10.497902 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.497880    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:10.498075 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:10.497919    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:10.498075 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:10.498003    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:12.214516 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:12.214472    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:12.214516 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:12.214519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:12.215131 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.214646    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:12.215131 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.214715    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret podName:30b8805a-d5a8-4a0f-8334-96625dd051b1 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:16.214696012 +0000 UTC m=+10.259992507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret") pod "global-pull-secret-syncer-bzwv4" (UID: "30b8805a-d5a8-4a0f-8334-96625dd051b1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:12.215131 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.214812    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:12.215131 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.214850    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:39:16.21483745 +0000 UTC m=+10.260133944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:12.316291 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:12.315600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:12.316291 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.315801    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:39:12.316291 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.315823    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:39:12.316291 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.315837    2569 projected.go:196] Error preparing data for projected volume kube-api-access-7qhqt for pod openshift-network-diagnostics/network-check-target-whhxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:12.316291 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.315903    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt podName:da37e445-bddb-4fe7-80ce-d4795c0c2042 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:16.315881161 +0000 UTC m=+10.361177659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qhqt" (UniqueName: "kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt") pod "network-check-target-whhxk" (UID: "da37e445-bddb-4fe7-80ce-d4795c0c2042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:12.495816 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:12.495723    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:12.496030 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.495882    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:12.496334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:12.496308    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:12.496457 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.496435    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:12.496686 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:12.496667    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:12.496795 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:12.496771    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:14.494578 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:14.494524    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:14.495117 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:14.494523    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:14.495117 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:14.494763    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:14.495117 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:14.494847    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:14.495117 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:14.494595    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:14.495117 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:14.494960    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:16.253936 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:16.253898    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:16.254459 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:16.253948    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:16.254459 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.254076    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:16.254459 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.254090    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:16.254459 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.254146    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:39:24.254125874 +0000 UTC m=+18.299422375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:16.254459 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.254167    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret podName:30b8805a-d5a8-4a0f-8334-96625dd051b1 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:24.254155742 +0000 UTC m=+18.299452241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret") pod "global-pull-secret-syncer-bzwv4" (UID: "30b8805a-d5a8-4a0f-8334-96625dd051b1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:16.354545 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:16.354480    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:16.354783 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.354762    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:39:16.354849 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.354795    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:39:16.354849 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.354810    2569 projected.go:196] Error preparing data for projected volume kube-api-access-7qhqt for pod openshift-network-diagnostics/network-check-target-whhxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:16.354961 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.354891    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt podName:da37e445-bddb-4fe7-80ce-d4795c0c2042 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:24.354868262 +0000 UTC m=+18.400164755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qhqt" (UniqueName: "kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt") pod "network-check-target-whhxk" (UID: "da37e445-bddb-4fe7-80ce-d4795c0c2042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:16.495002 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:16.494968    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:16.495210 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.495079    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:16.495210 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:16.495167    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:16.495335 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.495258    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:16.495335 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:16.495301    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:16.495443 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:16.495377    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:18.497136 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:18.497097    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:18.497654 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:18.497261    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:18.497739 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:18.497682    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:18.497955 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:18.497791    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:18.498629 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:18.498605    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:18.498789 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:18.498765    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:20.494314 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:20.494273    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:20.494835 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:20.494274    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:20.494835 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:20.494410    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:20.494835 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:20.494426    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:20.494835 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:20.494516    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:20.494835 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:20.494615    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:22.494071 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:22.494031    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:22.494071 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:22.494076    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:22.494598 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:22.494031    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:22.494598 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:22.494176    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:22.494598 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:22.494233    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:22.494598 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:22.494351    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:24.318334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:24.318285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:24.318334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:24.318329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:24.318999 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.318470    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:24.318999 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.318551    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret podName:30b8805a-d5a8-4a0f-8334-96625dd051b1 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:40.318516397 +0000 UTC m=+34.363812887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret") pod "global-pull-secret-syncer-bzwv4" (UID: "30b8805a-d5a8-4a0f-8334-96625dd051b1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:24.318999 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.318471    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:24.318999 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.318627    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:39:40.318609301 +0000 UTC m=+34.363905789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:24.418771 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:24.418727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:24.418970 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.418865    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:39:24.418970 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.418881    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:39:24.418970 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.418892    2569 projected.go:196] Error preparing data for projected volume kube-api-access-7qhqt for pod openshift-network-diagnostics/network-check-target-whhxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:24.418970 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.418941    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt podName:da37e445-bddb-4fe7-80ce-d4795c0c2042 nodeName:}" failed. No retries permitted until 2026-07-09 17:39:40.418928528 +0000 UTC m=+34.464225017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qhqt" (UniqueName: "kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt") pod "network-check-target-whhxk" (UID: "da37e445-bddb-4fe7-80ce-d4795c0c2042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:24.497749 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:24.497717    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:24.497937 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:24.497718    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:24.497937 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.497850    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:24.498040 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.497954    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:24.498040 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:24.497723    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:24.498134 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:24.498055    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:26.495023 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:26.494985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:26.495479 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:26.495090    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:26.495479 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:26.495167    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:26.495479 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:26.495265    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:26.495479 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:26.495325    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:26.495479 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:26.495441    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:28.494672 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:28.494631    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:28.495124 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:28.494654    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:28.495124 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:28.494769    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:28.495124 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:28.494767    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:28.495124 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:28.494857    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:28.495124 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:28.494974    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:30.494335 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.494132    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:30.494897 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.494158    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:30.494897 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:30.494449    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:30.494897 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.494185    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:30.494897 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:30.494576    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:30.494897 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:30.494739    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:30.989417 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.989377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bpw6z" event={"ID":"c168d2cf-0c73-4d53-b6f7-c90175455360","Type":"ContainerStarted","Data":"0af6b854ae5ddddb0c0d85e4e56559a9363ac33ea18f49b56cf6bc679792362a"}
Jul 09 17:39:30.990845 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.990822    2569 generic.go:356] "Generic (PLEG): container finished" podID="279c3e22-e5e1-4049-b242-9b3fa3ab38c0" containerID="bd482ddf93faf407e5e995132080d9e6f8dcf566970587b55b3c0294fd392b47" exitCode=0
Jul 09 17:39:30.991004 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.990894    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerDied","Data":"bd482ddf93faf407e5e995132080d9e6f8dcf566970587b55b3c0294fd392b47"}
Jul 09 17:39:30.992463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.992437    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v" event={"ID":"1db691a5-cf23-4aa4-8852-52441b0aa37a","Type":"ContainerStarted","Data":"a8633a8b0580ca6e613e49bd455cd72d7728899112b37a8a486275f7d545b407"}
Jul 09 17:39:30.994448 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.994418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzwg4" event={"ID":"2e27f024-165e-4c54-899e-d2c111f4afa6","Type":"ContainerStarted","Data":"5353faf39869a811fec2ecf956217f160419d226de0e9627d98634cc422bcf21"}
Jul 09 17:39:30.996056 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.996030    2569 generic.go:356] "Generic (PLEG): container finished" podID="a090b1eff3820c7ae8f86d37c5d4bd56" containerID="089d11ca6ee851e89ed2e33c6053f7c119a3cd34a65ca49c6283927174c035f8" exitCode=0
Jul 09 17:39:30.996152 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.996065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal" event={"ID":"a090b1eff3820c7ae8f86d37c5d4bd56","Type":"ContainerDied","Data":"089d11ca6ee851e89ed2e33c6053f7c119a3cd34a65ca49c6283927174c035f8"}
Jul 09 17:39:30.999892 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:30.999839    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal" event={"ID":"c36f7378c668aa82a44a3b3d0710dfe6","Type":"ContainerStarted","Data":"54aa687f28264d85b5eba8721508fb51a5adce93021f35a2d3f1d74407803f68"}
Jul 09 17:39:31.002178 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.002152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jv2d4" event={"ID":"b1dff61c-89a0-415f-91a5-426707f4110d","Type":"ContainerStarted","Data":"8a18874eaa6ca834bc2c7d5a2caa4d34877a0812237d5b46a533d41430901d1b"}
Jul 09 17:39:31.004750 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.004732    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:39:31.005065 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.005046    2569 generic.go:356] "Generic (PLEG): container finished" podID="87ca8c12-18c1-42cf-939b-d23596f4e426" containerID="62e045cf6c2f84e8032099e7b48a0807b6726f61a9c53533e72424adf8c7dda3" exitCode=1
Jul 09 17:39:31.005145 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.005073    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"095d62ce3cf82e8e4d4da6ade778ffe635e963e73d4aa79143f021a8a349c495"}
Jul 09 17:39:31.005199 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.005158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"99f65bdfa05aa663de41a2871baf8e3dcdaa8c113e86de6d0a08dda7ada1960e"}
Jul 09 17:39:31.005258 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.005206    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"0d33e74aaf317e124376d4cc9673c1e5dc146832b268a4ea1ec9666d2932bf19"}
Jul 09 17:39:31.005258 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.005251    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"3bbf6af78c7526c14299df9928f5aca71e0e8c460cb92658e6c57e4f0b6868fb"}
Jul 09 17:39:31.005370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.005299    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerDied","Data":"62e045cf6c2f84e8032099e7b48a0807b6726f61a9c53533e72424adf8c7dda3"}
Jul 09 17:39:31.005370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.005353    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"87cc2a18e0471583c6ab98d82bb22f369f9f9d36ae6321591c780c487b74d132"}
Jul 09 17:39:31.006633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.006605    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdxkr" event={"ID":"f8dc5e42-1b09-432e-827b-bd8ab962b3b4","Type":"ContainerStarted","Data":"c9d89e4f25c7d9a0f18aecc1ed856e7d996c7cba4566f0e253dba3f26a0d97f7"}
Jul 09 17:39:31.008253 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.008231    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9spw" event={"ID":"caf69956-4806-45a0-8f7e-e61a98441332","Type":"ContainerStarted","Data":"575091bca6544acc5c6e5268dab5c425507b3421f19cc2adb366f9536adca175"}
Jul 09 17:39:31.010593 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.010553    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bpw6z" podStartSLOduration=2.7993155180000002 podStartE2EDuration="24.010539452s" totalImagesPullingTime="21.211223934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:31.010044387 +0000 UTC m=+25.055340900" watchObservedRunningTime="2026-07-09 17:39:31.010539452 +0000 UTC m=+25.055835957"
Jul 09 17:39:31.066934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.066744    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hdxkr" podStartSLOduration=3.110049499 podStartE2EDuration="24.066727544s" totalImagesPullingTime="20.956678045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:31.066337357 +0000 UTC m=+25.111633869" watchObservedRunningTime="2026-07-09 17:39:31.066727544 +0000 UTC m=+25.112024055"
Jul 09 17:39:31.067065 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.067036    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jv2d4" podStartSLOduration=3.256216536 podStartE2EDuration="24.067028722s" totalImagesPullingTime="20.810812186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:31.051675225 +0000 UTC m=+25.096971735" watchObservedRunningTime="2026-07-09 17:39:31.067028722 +0000 UTC m=+25.112325272"
Jul 09 17:39:31.108348 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.108287    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-118.ec2.internal" podStartSLOduration=23.108269985 podStartE2EDuration="23.108269985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:31.108061267 +0000 UTC m=+25.153357778" watchObservedRunningTime="2026-07-09 17:39:31.108269985 +0000 UTC m=+25.153566497"
Jul 09 17:39:31.125247 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.125193    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nzwg4" podStartSLOduration=2.939982434 podStartE2EDuration="24.125176333s" totalImagesPullingTime="21.185193899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:31.124920113 +0000 UTC m=+25.170216621" watchObservedRunningTime="2026-07-09 17:39:31.125176333 +0000 UTC m=+25.170472843"
Jul 09 17:39:31.139997 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.139933    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z9spw" podStartSLOduration=3.157744303 podStartE2EDuration="24.139910855s" totalImagesPullingTime="20.982166552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:31.138966295 +0000 UTC m=+25.184262806" watchObservedRunningTime="2026-07-09 17:39:31.139910855 +0000 UTC m=+25.185207367"
Jul 09 17:39:31.543070 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.543032    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:31.544308 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:31.544276    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:32.013083 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.012829    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7cc9" event={"ID":"b8b46a38-bde5-4704-b15f-f4580a161033","Type":"ContainerStarted","Data":"a31948cc4df7509a0aff31f93089793636f5e185bd720e2e2a98f22c52360fa1"}
Jul 09 17:39:32.014933 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.014888    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal" event={"ID":"a090b1eff3820c7ae8f86d37c5d4bd56","Type":"ContainerStarted","Data":"1e75743d176eb4b7a92352d71bb4ad1caaa8e22a69676720557482f70b07b6ee"}
Jul 09 17:39:32.016187 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.016154    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:32.016332 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.016204    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bpw6z"
Jul 09 17:39:32.036709 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.036639    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b7cc9" podStartSLOduration=3.83147569 podStartE2EDuration="25.036615426s" totalImagesPullingTime="21.205139736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:32.036157344 +0000 UTC m=+26.081453856" watchObservedRunningTime="2026-07-09 17:39:32.036615426 +0000 UTC m=+26.081911938"
Jul 09 17:39:32.055421 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.055369    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-118.ec2.internal" podStartSLOduration=24.055351655 podStartE2EDuration="24.055351655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:32.055006033 +0000 UTC m=+26.100302544" watchObservedRunningTime="2026-07-09 17:39:32.055351655 +0000 UTC m=+26.100648165"
Jul 09 17:39:32.207003 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.206975    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 17:39:32.452591 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.452415    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T17:39:32.206995695Z","UUID":"b9519025-5f7c-43c7-85fb-c1f133a81688","Handler":null,"Name":"","Endpoint":""}
Jul 09 17:39:32.454453 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.454427    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 17:39:32.454620 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.454474    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 17:39:32.494574 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.494540    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:32.494779 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.494521    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:32.494779 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:32.494680    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:32.494779 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:32.494671    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:32.494939 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:32.494791    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:32.494939 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:32.494877    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:33.021493 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:33.021457    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v" event={"ID":"1db691a5-cf23-4aa4-8852-52441b0aa37a","Type":"ContainerStarted","Data":"8db38a149f785f14db5e9989f686883771733a0ab234f6caca75375e07b38c01"}
Jul 09 17:39:34.026293 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:34.026195    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v" event={"ID":"1db691a5-cf23-4aa4-8852-52441b0aa37a","Type":"ContainerStarted","Data":"e7c969f0491832eaede30bd6aea3a90d1596be0b0616a14f07df2ef3dc6c696e"}
Jul 09 17:39:34.029715 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:34.029686    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:39:34.030117 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:34.030086    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"2c03c2cb2d1ff41583d2c2e4c92cf121b2f7385dad757a057822bc5568307864"}
Jul 09 17:39:34.494499 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:34.494453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:34.494705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:34.494460    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:34.494705 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:34.494603    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:34.494705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:34.494659    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:34.494872 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:34.494755    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:34.494872 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:34.494849    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:36.037307 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.037063    2569 generic.go:356] "Generic (PLEG): container finished" podID="279c3e22-e5e1-4049-b242-9b3fa3ab38c0" containerID="3783f8694bcff25667f2c2a4915d043d2350a1e2c4c0fb5d7eb9113f054333f9" exitCode=0
Jul 09 17:39:36.038051 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.037146    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerDied","Data":"3783f8694bcff25667f2c2a4915d043d2350a1e2c4c0fb5d7eb9113f054333f9"}
Jul 09 17:39:36.041647 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.041622    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:39:36.044949 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.044918    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"b7e8591bddc53969832b48d6eb1a4037cc3f1fb5581c65c6ee2eb4247599e2d4"}
Jul 09 17:39:36.045225 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.045206    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:36.045439 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.045424    2569 scope.go:117] "RemoveContainer" containerID="62e045cf6c2f84e8032099e7b48a0807b6726f61a9c53533e72424adf8c7dda3"
Jul 09 17:39:36.061724 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.061701    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:36.062264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.062225    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mkx4v" podStartSLOduration=5.362231756 podStartE2EDuration="29.062211258s" totalImagesPullingTime="23.699979502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:34.055338463 +0000 UTC m=+28.100634969" watchObservedRunningTime="2026-07-09 17:39:36.062211258 +0000 UTC m=+30.107507747"
Jul 09 17:39:36.494537 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.494496    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:36.494718 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.494577    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:36.494718 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:36.494589    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:36.494718 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:36.494666    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:36.494822 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:36.494727    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:36.494822 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:36.494806    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:37.050827 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.050643    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:39:37.051341 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.051198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" event={"ID":"87ca8c12-18c1-42cf-939b-d23596f4e426","Type":"ContainerStarted","Data":"1ae825c46d742507f080d3fe94f4ae81caa820619ee0bb9ac7f34af95b131819"}
Jul 09 17:39:37.051497 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.051481    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:37.051583 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.051557    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:37.067137 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.067104    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:39:37.081864 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.081810    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg" podStartSLOduration=8.856580784 podStartE2EDuration="30.081792421s" totalImagesPullingTime="21.225211637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:37.080911546 +0000 UTC m=+31.126208060" watchObservedRunningTime="2026-07-09 17:39:37.081792421 +0000 UTC m=+31.127088931"
Jul 09 17:39:37.475580 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.475544    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whhxk"]
Jul 09 17:39:37.475762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.475720    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:37.475863 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:37.475839    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:37.478401 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.478378    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggjz7"]
Jul 09 17:39:37.478517 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.478479    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:37.478601 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:37.478584    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:37.487712 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.487683    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzwv4"]
Jul 09 17:39:37.487831 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:37.487792    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:37.487885 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:37.487869    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:38.055981 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:38.055944    2569 generic.go:356] "Generic (PLEG): container finished" podID="279c3e22-e5e1-4049-b242-9b3fa3ab38c0" containerID="12e038b8dd0d63ef9abaa340084de80b30b546f70c714ec074dbb900ebba1a2f" exitCode=0
Jul 09 17:39:38.056469 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:38.056032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerDied","Data":"12e038b8dd0d63ef9abaa340084de80b30b546f70c714ec074dbb900ebba1a2f"}
Jul 09 17:39:39.494665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:39.494629    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:39.495053 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:39.494667    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:39.495053 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:39.494633    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:39.495053 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:39.494744    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:39.495053 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:39.494832    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:39.495053 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:39.494916    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:40.062243 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:40.062206    2569 generic.go:356] "Generic (PLEG): container finished" podID="279c3e22-e5e1-4049-b242-9b3fa3ab38c0" containerID="c83d966700cc876fa3d3fdacbd775661557e476d8174be0323b17d206a7c5dfb" exitCode=0
Jul 09 17:39:40.062409 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:40.062271    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerDied","Data":"c83d966700cc876fa3d3fdacbd775661557e476d8174be0323b17d206a7c5dfb"}
Jul 09 17:39:40.337880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:40.337793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:40.337880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:40.337831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:40.338061 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.337938    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:40.338061 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.338007    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:40:12.337990488 +0000 UTC m=+66.383286978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:39:40.338061 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.337941    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:40.338061 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.338040    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret podName:30b8805a-d5a8-4a0f-8334-96625dd051b1 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:12.338033981 +0000 UTC m=+66.383330470 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret") pod "global-pull-secret-syncer-bzwv4" (UID: "30b8805a-d5a8-4a0f-8334-96625dd051b1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:39:40.438322 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:40.438279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:40.438735 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.438441    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:39:40.438735 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.438458    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:39:40.438735 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.438468    2569 projected.go:196] Error preparing data for projected volume kube-api-access-7qhqt for pod openshift-network-diagnostics/network-check-target-whhxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:40.438735 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:40.438548    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt podName:da37e445-bddb-4fe7-80ce-d4795c0c2042 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:12.438509575 +0000 UTC m=+66.483806084 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qhqt" (UniqueName: "kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt") pod "network-check-target-whhxk" (UID: "da37e445-bddb-4fe7-80ce-d4795c0c2042") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:39:41.494063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:41.493967    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:41.494063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:41.493995    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:41.494063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:41.493996    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:41.494619 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:41.494105    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whhxk" podUID="da37e445-bddb-4fe7-80ce-d4795c0c2042"
Jul 09 17:39:41.494619 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:41.494253    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggjz7" podUID="2e8195f6-2749-44b3-ab58-dfb07e57b84c"
Jul 09 17:39:41.494619 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:41.494333    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzwv4" podUID="30b8805a-d5a8-4a0f-8334-96625dd051b1"
Jul 09 17:39:43.300505 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.300467    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-118.ec2.internal" event="NodeReady"
Jul 09 17:39:43.300966 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.300649    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 17:39:43.344976 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.344938    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5855f948f7-462wj"]
Jul 09 17:39:43.373148 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.373105    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5855f948f7-462wj"]
Jul 09 17:39:43.373148 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.373152    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d4dmb"]
Jul 09 17:39:43.373381 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.373270    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.375886 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.375652    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 17:39:43.375886 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.375707    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 17:39:43.375886 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.375657    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 17:39:43.375886 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.375653    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5d6lq\""
Jul 09 17:39:43.381887 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.381859    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 17:39:43.387352 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.386905    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8qn5m"]
Jul 09 17:39:43.387352 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.387029    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.389729 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.389465    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 17:39:43.389729 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.389486    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 17:39:43.389729 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.389616    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dxrqg\""
Jul 09 17:39:43.402900 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.402870    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8qn5m"]
Jul 09 17:39:43.402900 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.402907    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d4dmb"]
Jul 09 17:39:43.403139 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.403017    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:43.406755 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.406715    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 17:39:43.406918 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.406817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2srhc\""
Jul 09 17:39:43.406918 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.406882    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 17:39:43.407204 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.407184    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 17:39:43.461055 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461015    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0cb2478-62d9-4880-862e-68300e64fbdb-ca-trust-extracted\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.461055 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461062    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-certificates\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.461297 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461089    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-trusted-ca\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.461297 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-bound-sa-token\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.461297 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.461297 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-installation-pull-secrets\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.461456 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-image-registry-private-configuration\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.461456 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.461395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh5n8\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-kube-api-access-vh5n8\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.494300 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.494252    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:39:43.494495 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.494252    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:39:43.494623 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.494264    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:39:43.496810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.496787    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 17:39:43.497165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.497145    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8d4pd\""
Jul 09 17:39:43.497286 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.497270    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 17:39:43.497450 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.497420    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 17:39:43.497641 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.497623    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 17:39:43.497641 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.497634    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wznvh\""
Jul 09 17:39:43.562024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.561940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-bound-sa-token\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.562024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.561988    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-tmp-dir\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.562264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b929dd4c-b28c-43cc-9362-87d73002435d-cert\") pod \"ingress-canary-8qn5m\" (UID: \"b929dd4c-b28c-43cc-9362-87d73002435d\") " pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:43.562264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.562264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.562264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-installation-pull-secrets\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.562264 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:43.562220    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 17:39:43.562264 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:43.562235    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855f948f7-462wj: secret "image-registry-tls" not found
Jul 09 17:39:43.562516 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:43.562320    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls podName:c0cb2478-62d9-4880-862e-68300e64fbdb nodeName:}" failed. No retries permitted until 2026-07-09 17:39:44.062299093 +0000 UTC m=+38.107595582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls") pod "image-registry-5855f948f7-462wj" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb") : secret "image-registry-tls" not found
Jul 09 17:39:43.562516 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562437    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-config-volume\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.562516 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-image-registry-private-configuration\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.562662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh5n8\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-kube-api-access-vh5n8\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.562662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562574    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxk9r\" (UniqueName: \"kubernetes.io/projected/b929dd4c-b28c-43cc-9362-87d73002435d-kube-api-access-wxk9r\") pod \"ingress-canary-8qn5m\" (UID: \"b929dd4c-b28c-43cc-9362-87d73002435d\") " pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:43.562662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562607    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w88gc\" (UniqueName: \"kubernetes.io/projected/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-kube-api-access-w88gc\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.562662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0cb2478-62d9-4880-862e-68300e64fbdb-ca-trust-extracted\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.562806 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-certificates\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.562806 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.562712    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-trusted-ca\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.563393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.563344    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0cb2478-62d9-4880-862e-68300e64fbdb-ca-trust-extracted\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.563726 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.563699    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-certificates\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.564073 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.564049    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-trusted-ca\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.567325 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.567293    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-installation-pull-secrets\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.567443 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.567297    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-image-registry-private-configuration\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.570505 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.570468    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-bound-sa-token\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.572580 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.572553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh5n8\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-kube-api-access-vh5n8\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:43.615073 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.615033    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:43.663585 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.663550    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.663782 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.663612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-config-volume\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.663782 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.663662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxk9r\" (UniqueName: \"kubernetes.io/projected/b929dd4c-b28c-43cc-9362-87d73002435d-kube-api-access-wxk9r\") pod \"ingress-canary-8qn5m\" (UID: \"b929dd4c-b28c-43cc-9362-87d73002435d\") " pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:43.663782 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.663692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w88gc\" (UniqueName: \"kubernetes.io/projected/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-kube-api-access-w88gc\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.663782 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:43.663730    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:39:43.663782 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.663752    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-tmp-dir\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.663782 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.663776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b929dd4c-b28c-43cc-9362-87d73002435d-cert\") pod \"ingress-canary-8qn5m\" (UID: \"b929dd4c-b28c-43cc-9362-87d73002435d\") " pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:43.664086 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:43.663811    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls podName:6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a nodeName:}" failed. No retries permitted until 2026-07-09 17:39:44.163790242 +0000 UTC m=+38.209086731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls") pod "dns-default-d4dmb" (UID: "6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a") : secret "dns-default-metrics-tls" not found
Jul 09 17:39:43.664307 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.664271    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-config-volume\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.664426 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.664311    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-tmp-dir\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.666767 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.666741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b929dd4c-b28c-43cc-9362-87d73002435d-cert\") pod \"ingress-canary-8qn5m\" (UID: \"b929dd4c-b28c-43cc-9362-87d73002435d\") " pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:43.673167 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.673132    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxk9r\" (UniqueName: \"kubernetes.io/projected/b929dd4c-b28c-43cc-9362-87d73002435d-kube-api-access-wxk9r\") pod \"ingress-canary-8qn5m\" (UID: \"b929dd4c-b28c-43cc-9362-87d73002435d\") " pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:43.675931 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.675902    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w88gc\" (UniqueName: \"kubernetes.io/projected/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-kube-api-access-w88gc\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:43.709861 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.709820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:43.713518 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:43.713477    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8qn5m"
Jul 09 17:39:44.068059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:44.067868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:44.068229 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:44.068019    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 17:39:44.068229 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:44.068138    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855f948f7-462wj: secret "image-registry-tls" not found
Jul 09 17:39:44.068229 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:44.068192    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls podName:c0cb2478-62d9-4880-862e-68300e64fbdb nodeName:}" failed. No retries permitted until 2026-07-09 17:39:45.068177958 +0000 UTC m=+39.113474446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls") pod "image-registry-5855f948f7-462wj" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb") : secret "image-registry-tls" not found
Jul 09 17:39:44.168634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:44.168599    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:44.168796 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:44.168773    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:39:44.168869 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:44.168859    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls podName:6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a nodeName:}" failed. No retries permitted until 2026-07-09 17:39:45.168840799 +0000 UTC m=+39.214137288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls") pod "dns-default-d4dmb" (UID: "6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a") : secret "dns-default-metrics-tls" not found
Jul 09 17:39:44.280698 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:44.280667    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8qn5m"]
Jul 09 17:39:44.358618 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:39:44.358545    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb929dd4c_b28c_43cc_9362_87d73002435d.slice/crio-0af549b25e1d5d6de838fc7cbc22674fb43e506aea8334d02be400c60f34a1d8 WatchSource:0}: Error finding container 0af549b25e1d5d6de838fc7cbc22674fb43e506aea8334d02be400c60f34a1d8: Status 404 returned error can't find the container with id 0af549b25e1d5d6de838fc7cbc22674fb43e506aea8334d02be400c60f34a1d8
Jul 09 17:39:45.075470 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:45.075423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8qn5m" event={"ID":"b929dd4c-b28c-43cc-9362-87d73002435d","Type":"ContainerStarted","Data":"0af549b25e1d5d6de838fc7cbc22674fb43e506aea8334d02be400c60f34a1d8"}
Jul 09 17:39:45.075698 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:45.075657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:45.075853 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:45.075837    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 17:39:45.075921 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:45.075856    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855f948f7-462wj: secret "image-registry-tls" not found
Jul 09 17:39:45.075921 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:45.075911    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls podName:c0cb2478-62d9-4880-862e-68300e64fbdb nodeName:}" failed. No retries permitted until 2026-07-09 17:39:47.075892513 +0000 UTC m=+41.121189017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls") pod "image-registry-5855f948f7-462wj" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb") : secret "image-registry-tls" not found
Jul 09 17:39:45.078512 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:45.078472    2569 generic.go:356] "Generic (PLEG): container finished" podID="279c3e22-e5e1-4049-b242-9b3fa3ab38c0" containerID="4f6f689c4eae2dd29727f3f797bcc1a5ad0ba4f8fd98f32eb48ef6acf9baadf9" exitCode=0
Jul 09 17:39:45.078667 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:45.078519    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerDied","Data":"4f6f689c4eae2dd29727f3f797bcc1a5ad0ba4f8fd98f32eb48ef6acf9baadf9"}
Jul 09 17:39:45.176593 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:45.176555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:45.176740 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:45.176712    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:39:45.176804 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:45.176781    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls podName:6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a nodeName:}" failed. No retries permitted until 2026-07-09 17:39:47.176758713 +0000 UTC m=+41.222055220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls") pod "dns-default-d4dmb" (UID: "6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a") : secret "dns-default-metrics-tls" not found
Jul 09 17:39:46.085475 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:46.085441    2569 generic.go:356] "Generic (PLEG): container finished" podID="279c3e22-e5e1-4049-b242-9b3fa3ab38c0" containerID="d7188a7b9e12f2e2246a9c32cb26fb3dcba45e92b788a2607b33619fa6be6cdf" exitCode=0
Jul 09 17:39:46.086278 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:46.085519    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerDied","Data":"d7188a7b9e12f2e2246a9c32cb26fb3dcba45e92b788a2607b33619fa6be6cdf"}
Jul 09 17:39:47.089920 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.089884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8qn5m" event={"ID":"b929dd4c-b28c-43cc-9362-87d73002435d","Type":"ContainerStarted","Data":"85a79d4aeeb46bff94de0dc7e24648e75dcc5730eaee5cfec60f42ac368faf7a"}
Jul 09 17:39:47.090834 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.090815    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:47.090959 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:47.090940    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 17:39:47.091013 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:47.090962    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855f948f7-462wj: secret "image-registry-tls" not found
Jul 09 17:39:47.091051 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:47.091028    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls podName:c0cb2478-62d9-4880-862e-68300e64fbdb nodeName:}" failed. No retries permitted until 2026-07-09 17:39:51.091006293 +0000 UTC m=+45.136302789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls") pod "image-registry-5855f948f7-462wj" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb") : secret "image-registry-tls" not found
Jul 09 17:39:47.093120 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.093094    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" event={"ID":"279c3e22-e5e1-4049-b242-9b3fa3ab38c0","Type":"ContainerStarted","Data":"d7d7bc8d4ab8aae4b94d8646dfe20421849c979eb87f8d02f6ed8b455c9e945b"}
Jul 09 17:39:47.122332 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.122279    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8qn5m" podStartSLOduration=1.809750115 podStartE2EDuration="4.122261598s" totalImagesPullingTime="2.312511483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:47.120658105 +0000 UTC m=+41.165954616" watchObservedRunningTime="2026-07-09 17:39:47.122261598 +0000 UTC m=+41.167558109"
Jul 09 17:39:47.191477 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.191391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:47.191752 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:47.191728    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:39:47.191867 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:47.191795    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls podName:6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a nodeName:}" failed. No retries permitted until 2026-07-09 17:39:51.1917757 +0000 UTC m=+45.237072189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls") pod "dns-default-d4dmb" (UID: "6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a") : secret "dns-default-metrics-tls" not found
Jul 09 17:39:47.515917 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.515875    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:47.590735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.590695    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:47.921008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:47.920977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:48.039959 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:48.039925    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:48.698738 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:48.698707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:48.761759 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:48.761723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:49.683814 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:49.683779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:49.778761 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:49.778731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:49.882349 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:49.882319    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:49.949644 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:49.949544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:51.121170 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:51.121127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:51.121612 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:51.121299    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 17:39:51.121612 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:51.121320    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855f948f7-462wj: secret "image-registry-tls" not found
Jul 09 17:39:51.121612 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:51.121376    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls podName:c0cb2478-62d9-4880-862e-68300e64fbdb nodeName:}" failed. No retries permitted until 2026-07-09 17:39:59.121360198 +0000 UTC m=+53.166656687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls") pod "image-registry-5855f948f7-462wj" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb") : secret "image-registry-tls" not found
Jul 09 17:39:51.164049 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:51.164005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:51.222415 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:51.222381    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:51.222606 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:51.222583    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:39:51.222694 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:51.222664    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls podName:6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a nodeName:}" failed. No retries permitted until 2026-07-09 17:39:59.222644052 +0000 UTC m=+53.267940548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls") pod "dns-default-d4dmb" (UID: "6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a") : secret "dns-default-metrics-tls" not found
Jul 09 17:39:51.260721 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:51.260681    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:51.459722 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:51.459688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:51.560204 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:51.560158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:52.066811 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:52.066774    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:52.136812 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:52.136773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:52.213800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:52.213762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:52.298086 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:52.298058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:53.684930 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:53.684891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:55.015108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:55.015073    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:39:59.181372 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.181332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:39:59.181796 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:59.181486    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 17:39:59.181796 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:59.181505    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5855f948f7-462wj: secret "image-registry-tls" not found
Jul 09 17:39:59.181796 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:59.181592    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls podName:c0cb2478-62d9-4880-862e-68300e64fbdb nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.181575597 +0000 UTC m=+69.226872087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls") pod "image-registry-5855f948f7-462wj" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb") : secret "image-registry-tls" not found
Jul 09 17:39:59.281700 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.281666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:39:59.281858 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:59.281817    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 17:39:59.281896 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:59.281888    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls podName:6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.281872199 +0000 UTC m=+69.327168688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls") pod "dns-default-d4dmb" (UID: "6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a") : secret "dns-default-metrics-tls" not found
Jul 09 17:39:59.715418 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.715361    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qgsxj" podStartSLOduration=20.593473644 podStartE2EDuration="52.715343298s" totalImagesPullingTime="32.121869654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:39:47.168053181 +0000 UTC m=+41.213349691" watchObservedRunningTime="2026-07-09 17:39:59.715343298 +0000 UTC m=+53.760639886"
Jul 09 17:39:59.715628 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.715615    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"]
Jul 09 17:39:59.735667 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.735633    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"]
Jul 09 17:39:59.735846 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.735766    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.737904 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.737882    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:39:59.738543 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.738509    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 17:39:59.738543 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.738516    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 17:39:59.738720 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.738561    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2prhz\""
Jul 09 17:39:59.738720 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.738573    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 17:39:59.786232 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.786191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.786399 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.786248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.786399 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.786324    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdkrg\" (UniqueName: \"kubernetes.io/projected/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-kube-api-access-fdkrg\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.815164 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.815131    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"]
Jul 09 17:39:59.840812 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.840778    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"]
Jul 09 17:39:59.840964 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.840940    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:39:59.843080 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.843055    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vkd8j\""
Jul 09 17:39:59.843279 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.843055    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 17:39:59.843362 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.843060    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 17:39:59.843417 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.843068    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:39:59.864706 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.864673    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-vt7q5"]
Jul 09 17:39:59.864886 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.864796    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.867175 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.867153    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 09 17:39:59.867306 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.867157    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 09 17:39:59.867306 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.867157    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:39:59.867494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.867481    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 09 17:39:59.868215 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.868195    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9rq2v\""
Jul 09 17:39:59.886912 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.886880    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:39:59.886912 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.886919    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.887108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.886964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.887108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.887002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb26d\" (UniqueName: \"kubernetes.io/projected/cca94c02-4238-466d-a7c5-e3150443423a-kube-api-access-cb26d\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.887108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.887023    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp5bg\" (UniqueName: \"kubernetes.io/projected/f4b00349-f025-4284-9cb4-4db5801ccf9a-kube-api-access-hp5bg\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:39:59.887108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.887043    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdkrg\" (UniqueName: \"kubernetes.io/projected/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-kube-api-access-fdkrg\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.887108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.887084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cca94c02-4238-466d-a7c5-e3150443423a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.887319 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.887161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cca94c02-4238-466d-a7c5-e3150443423a-config\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.887479 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.887461    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.888661 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.888642    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"]
Jul 09 17:39:59.888750 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.888684    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vt7q5"]
Jul 09 17:39:59.888750 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.888706    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"]
Jul 09 17:39:59.888821 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.888758    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:39:59.890896 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.890877    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.891468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.891448    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tdqq2\""
Jul 09 17:39:59.891616 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.891594    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:39:59.891714 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.891658    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 17:39:59.893120 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.893100    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 17:39:59.893303 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.893288    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 17:39:59.900162 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.900108    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdkrg\" (UniqueName: \"kubernetes.io/projected/8b0a5699-d24e-46c4-bfcf-6db4240b79dc-kube-api-access-fdkrg\") pod \"kube-storage-version-migrator-operator-799cb7f958-rssm7\" (UID: \"8b0a5699-d24e-46c4-bfcf-6db4240b79dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:39:59.901216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.901198    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 17:39:59.927187 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.927148    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"]
Jul 09 17:39:59.949329 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.949289    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ft7pk"]
Jul 09 17:39:59.949482 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.949431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:39:59.952768 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.952743    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ff9nf\""
Jul 09 17:39:59.953515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.953497    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 17:39:59.953648 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.953512    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 17:39:59.953933 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.953912    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 17:39:59.954021 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.953963    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 17:39:59.969249 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.969168    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bc67f59d-8gfgw"]
Jul 09 17:39:59.969249 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.969233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:39:59.972110 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.972055    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 17:39:59.972373 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.972350    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d9mml\""
Jul 09 17:39:59.972746 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.972729    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 17:39:59.973220 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.973204    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 17:39:59.973356 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.973307    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 17:39:59.981356 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.981329    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 17:39:59.988075 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988050    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85cf20b4-45ae-412d-9f6b-83163c17afee-serving-cert\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:39:59.988194 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqd6\" (UniqueName: \"kubernetes.io/projected/85cf20b4-45ae-412d-9f6b-83163c17afee-kube-api-access-6tqd6\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:39:59.988194 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7db9ab0-1686-44e0-9ad0-5496588b6eca-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:39:59.988194 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cca94c02-4238-466d-a7c5-e3150443423a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.988304 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:39:59.988304 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:39:59.988304 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb26d\" (UniqueName: \"kubernetes.io/projected/cca94c02-4238-466d-a7c5-e3150443423a-kube-api-access-cb26d\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.988304 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxpd2\" (UniqueName: \"kubernetes.io/projected/b7db9ab0-1686-44e0-9ad0-5496588b6eca-kube-api-access-zxpd2\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:39:59.988444 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988318    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7db9ab0-1686-44e0-9ad0-5496588b6eca-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:39:59.988444 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85cf20b4-45ae-412d-9f6b-83163c17afee-trusted-ca\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:39:59.988444 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:59.988350    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 17:39:59.988444 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85cf20b4-45ae-412d-9f6b-83163c17afee-config\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:39:59.988444 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:39:59.988408    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls podName:f4b00349-f025-4284-9cb4-4db5801ccf9a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:00.48839257 +0000 UTC m=+54.533689069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls") pod "cluster-samples-operator-65db858894-jtvnl" (UID: "f4b00349-f025-4284-9cb4-4db5801ccf9a") : secret "samples-operator-tls" not found
Jul 09 17:39:59.988665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988480    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp5bg\" (UniqueName: \"kubernetes.io/projected/f4b00349-f025-4284-9cb4-4db5801ccf9a-kube-api-access-hp5bg\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:39:59.988665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988511    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7db9ab0-1686-44e0-9ad0-5496588b6eca-tmp\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:39:59.988665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k54rz\" (UniqueName: \"kubernetes.io/projected/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-kube-api-access-k54rz\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:39:59.988665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988608    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cca94c02-4238-466d-a7c5-e3150443423a-config\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.988665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:39:59.988850 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988669    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b7db9ab0-1686-44e0-9ad0-5496588b6eca-snapshots\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:39:59.988850 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.988708    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7db9ab0-1686-44e0-9ad0-5496588b6eca-serving-cert\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:39:59.989052 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.989035    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cca94c02-4238-466d-a7c5-e3150443423a-config\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.990590 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.990570    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cca94c02-4238-466d-a7c5-e3150443423a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:39:59.991163 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.991147    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ft7pk"]
Jul 09 17:39:59.991229 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.991174    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"]
Jul 09 17:39:59.991229 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.991189    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc67f59d-8gfgw"]
Jul 09 17:39:59.991322 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.991263    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:39:59.993932 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.993890    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 17:39:59.994103 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.994027    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 17:39:59.994183 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.994105    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 17:39:59.994183 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.994133    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vc5pp\""
Jul 09 17:39:59.994494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.994471    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 17:39:59.994494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.994486    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 17:39:59.994778 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:39:59.994762    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 17:40:00.003953 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.003925    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb26d\" (UniqueName: \"kubernetes.io/projected/cca94c02-4238-466d-a7c5-e3150443423a-kube-api-access-cb26d\") pod \"service-ca-operator-7695fc6c8c-n7xwx\" (UID: \"cca94c02-4238-466d-a7c5-e3150443423a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:40:00.004093 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.004080    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp5bg\" (UniqueName: \"kubernetes.io/projected/f4b00349-f025-4284-9cb4-4db5801ccf9a-kube-api-access-hp5bg\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:00.045247 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.045214    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"
Jul 09 17:40:00.089635 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.089595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:00.089789 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.089656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-stats-auth\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.089832 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.089784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxpd2\" (UniqueName: \"kubernetes.io/projected/b7db9ab0-1686-44e0-9ad0-5496588b6eca-kube-api-access-zxpd2\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.089832 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.089803    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:00.089897 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.089834    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7db9ab0-1686-44e0-9ad0-5496588b6eca-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.089897 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.089860    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85cf20b4-45ae-412d-9f6b-83163c17afee-trusted-ca\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.089897 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.089890    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls podName:c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e nodeName:}" failed. No retries permitted until 2026-07-09 17:40:00.589866242 +0000 UTC m=+54.635162787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rnn78" (UID: "c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e") : secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:00.090034 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.089940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85cf20b4-45ae-412d-9f6b-83163c17afee-config\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.090034 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.089985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.090034 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7db9ab0-1686-44e0-9ad0-5496588b6eca-tmp\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.090168 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.090168 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k54rz\" (UniqueName: \"kubernetes.io/projected/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-kube-api-access-k54rz\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:00.090168 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090125    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9fdd\" (UniqueName: \"kubernetes.io/projected/747e8e45-5c52-4275-baa8-3218cdbfb8e8-kube-api-access-z9fdd\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.090313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:00.090313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b7db9ab0-1686-44e0-9ad0-5496588b6eca-snapshots\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.090313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090265    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7db9ab0-1686-44e0-9ad0-5496588b6eca-serving-cert\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85cf20b4-45ae-412d-9f6b-83163c17afee-serving-cert\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqd6\" (UniqueName: \"kubernetes.io/projected/85cf20b4-45ae-412d-9f6b-83163c17afee-kube-api-access-6tqd6\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090675    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-default-certificate\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090707    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7db9ab0-1686-44e0-9ad0-5496588b6eca-tmp\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.090717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7db9ab0-1686-44e0-9ad0-5496588b6eca-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.091011    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85cf20b4-45ae-412d-9f6b-83163c17afee-config\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.091173    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b7db9ab0-1686-44e0-9ad0-5496588b6eca-snapshots\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.091193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7db9ab0-1686-44e0-9ad0-5496588b6eca-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.091216 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.091213    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:00.091705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.091283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85cf20b4-45ae-412d-9f6b-83163c17afee-trusted-ca\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.091705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.091457    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7db9ab0-1686-44e0-9ad0-5496588b6eca-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.093241 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.093219    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7db9ab0-1686-44e0-9ad0-5496588b6eca-serving-cert\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.093486 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.093466    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85cf20b4-45ae-412d-9f6b-83163c17afee-serving-cert\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.111849 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.111819    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k54rz\" (UniqueName: \"kubernetes.io/projected/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-kube-api-access-k54rz\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:00.111998 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.111935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxpd2\" (UniqueName: \"kubernetes.io/projected/b7db9ab0-1686-44e0-9ad0-5496588b6eca-kube-api-access-zxpd2\") pod \"insights-operator-68d9dd94cf-ft7pk\" (UID: \"b7db9ab0-1686-44e0-9ad0-5496588b6eca\") " pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.116585 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.116545    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqd6\" (UniqueName: \"kubernetes.io/projected/85cf20b4-45ae-412d-9f6b-83163c17afee-kube-api-access-6tqd6\") pod \"console-operator-7866497494-vt7q5\" (UID: \"85cf20b4-45ae-412d-9f6b-83163c17afee\") " pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.173995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.173961    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"
Jul 09 17:40:00.191350 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.191311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-default-certificate\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.191815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.191385    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-stats-auth\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.191815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.191434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.191815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.191453    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.191815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.191483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9fdd\" (UniqueName: \"kubernetes.io/projected/747e8e45-5c52-4275-baa8-3218cdbfb8e8-kube-api-access-z9fdd\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.191815 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.191586    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 17:40:00.191815 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.191622    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:00.69160371 +0000 UTC m=+54.736900213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : configmap references non-existent config key: service-ca.crt
Jul 09 17:40:00.191815 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.191664    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:00.691645672 +0000 UTC m=+54.736942174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : secret "router-metrics-certs-default" not found
Jul 09 17:40:00.193811 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.193791    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-default-certificate\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.193889 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.193833    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-stats-auth\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.203700 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.203669    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7"]
Jul 09 17:40:00.205841 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.205818    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9fdd\" (UniqueName: \"kubernetes.io/projected/747e8e45-5c52-4275-baa8-3218cdbfb8e8-kube-api-access-z9fdd\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.207263 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:00.207235    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0a5699_d24e_46c4_bfcf_6db4240b79dc.slice/crio-a567e870a593c539c43ade2df1e0503b7a6878ecf002a7d2b2bad409b2bb620e WatchSource:0}: Error finding container a567e870a593c539c43ade2df1e0503b7a6878ecf002a7d2b2bad409b2bb620e: Status 404 returned error can't find the container with id a567e870a593c539c43ade2df1e0503b7a6878ecf002a7d2b2bad409b2bb620e
Jul 09 17:40:00.207662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.207646    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:00.209025 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.208869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:00.279899 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.279861    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk"
Jul 09 17:40:00.315259 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.315215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:00.340920 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.339082    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx"]
Jul 09 17:40:00.343976 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:00.343947    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca94c02_4238_466d_a7c5_e3150443423a.slice/crio-a5f8672e81b3c4e1dea1e38eeabae2388c1b613208ed73c71fe2e81b191ab0a1 WatchSource:0}: Error finding container a5f8672e81b3c4e1dea1e38eeabae2388c1b613208ed73c71fe2e81b191ab0a1: Status 404 returned error can't find the container with id a5f8672e81b3c4e1dea1e38eeabae2388c1b613208ed73c71fe2e81b191ab0a1
Jul 09 17:40:00.398657 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.398616    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vt7q5"]
Jul 09 17:40:00.403028 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:00.403002    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cf20b4_45ae_412d_9f6b_83163c17afee.slice/crio-ad5f59d1734687604e76905c77465c596f2c5071b896323a939d85edf8b2ff6e WatchSource:0}: Error finding container ad5f59d1734687604e76905c77465c596f2c5071b896323a939d85edf8b2ff6e: Status 404 returned error can't find the container with id ad5f59d1734687604e76905c77465c596f2c5071b896323a939d85edf8b2ff6e
Jul 09 17:40:00.443175 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.443136    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ft7pk"]
Jul 09 17:40:00.446015 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:00.445984    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7db9ab0_1686_44e0_9ad0_5496588b6eca.slice/crio-8caa0b332ad1b5a0fde9a3d6128982f02062e1b32f6515699e03bef9cd3d645f WatchSource:0}: Error finding container 8caa0b332ad1b5a0fde9a3d6128982f02062e1b32f6515699e03bef9cd3d645f: Status 404 returned error can't find the container with id 8caa0b332ad1b5a0fde9a3d6128982f02062e1b32f6515699e03bef9cd3d645f
Jul 09 17:40:00.494340 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.494240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:00.494517 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.494398    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 17:40:00.494517 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.494472    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls podName:f4b00349-f025-4284-9cb4-4db5801ccf9a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:01.494451636 +0000 UTC m=+55.539748125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls") pod "cluster-samples-operator-65db858894-jtvnl" (UID: "f4b00349-f025-4284-9cb4-4db5801ccf9a") : secret "samples-operator-tls" not found
Jul 09 17:40:00.595028 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.594983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:00.595222 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.595134    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:00.595222 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.595200    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls podName:c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e nodeName:}" failed. No retries permitted until 2026-07-09 17:40:01.595185411 +0000 UTC m=+55.640481900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rnn78" (UID: "c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e") : secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:00.695743 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.695701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.695743 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:00.695745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:00.695993 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.695900    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:01.695876327 +0000 UTC m=+55.741172838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : configmap references non-existent config key: service-ca.crt
Jul 09 17:40:00.695993 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.695927    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 17:40:00.695993 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:00.695980    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:01.695968005 +0000 UTC m=+55.741264495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : secret "router-metrics-certs-default" not found
Jul 09 17:40:01.132674 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.132594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk" event={"ID":"b7db9ab0-1686-44e0-9ad0-5496588b6eca","Type":"ContainerStarted","Data":"8caa0b332ad1b5a0fde9a3d6128982f02062e1b32f6515699e03bef9cd3d645f"}
Jul 09 17:40:01.134411 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.134375    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx" event={"ID":"cca94c02-4238-466d-a7c5-e3150443423a","Type":"ContainerStarted","Data":"a5f8672e81b3c4e1dea1e38eeabae2388c1b613208ed73c71fe2e81b191ab0a1"}
Jul 09 17:40:01.136973 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.136895    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vt7q5" event={"ID":"85cf20b4-45ae-412d-9f6b-83163c17afee","Type":"ContainerStarted","Data":"ad5f59d1734687604e76905c77465c596f2c5071b896323a939d85edf8b2ff6e"}
Jul 09 17:40:01.138794 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.138766    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7" event={"ID":"8b0a5699-d24e-46c4-bfcf-6db4240b79dc","Type":"ContainerStarted","Data":"a567e870a593c539c43ade2df1e0503b7a6878ecf002a7d2b2bad409b2bb620e"}
Jul 09 17:40:01.449194 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.449150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:01.504692 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.504654    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:01.504881 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:01.504826    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 17:40:01.504952 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:01.504893    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls podName:f4b00349-f025-4284-9cb4-4db5801ccf9a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:03.504874112 +0000 UTC m=+57.550170609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls") pod "cluster-samples-operator-65db858894-jtvnl" (UID: "f4b00349-f025-4284-9cb4-4db5801ccf9a") : secret "samples-operator-tls" not found
Jul 09 17:40:01.555037 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.554996    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:01.605999 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.605960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:01.606212 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:01.606159    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:01.606288 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:01.606233    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls podName:c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e nodeName:}" failed. No retries permitted until 2026-07-09 17:40:03.606214451 +0000 UTC m=+57.651510941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rnn78" (UID: "c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e") : secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:01.707411 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.707312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:01.707655 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:01.707478    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 17:40:01.707655 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:01.707554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:01.707655 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:01.707575    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:03.707554306 +0000 UTC m=+57.752850795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : secret "router-metrics-certs-default" not found
Jul 09 17:40:01.707832 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:01.707668    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:03.707652306 +0000 UTC m=+57.752948798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : configmap references non-existent config key: service-ca.crt
Jul 09 17:40:03.525499 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:03.525452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:03.526006 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:03.525629    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 17:40:03.526006 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:03.525717    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls podName:f4b00349-f025-4284-9cb4-4db5801ccf9a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:07.525695649 +0000 UTC m=+61.570992147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls") pod "cluster-samples-operator-65db858894-jtvnl" (UID: "f4b00349-f025-4284-9cb4-4db5801ccf9a") : secret "samples-operator-tls" not found
Jul 09 17:40:03.627082 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:03.627037    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:03.627260 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:03.627227    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:03.627343 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:03.627314    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls podName:c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e nodeName:}" failed. No retries permitted until 2026-07-09 17:40:07.627291072 +0000 UTC m=+61.672587577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rnn78" (UID: "c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e") : secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:03.727758 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:03.727718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:03.727923 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:03.727766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:03.727923 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:03.727901    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:07.727880542 +0000 UTC m=+61.773177050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : configmap references non-existent config key: service-ca.crt
Jul 09 17:40:03.728000 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:03.727956    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 17:40:03.728038 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:03.728025    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:07.728008025 +0000 UTC m=+61.773304529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : secret "router-metrics-certs-default" not found
Jul 09 17:40:04.735176 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:04.735137    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:04.832303 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:04.832250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:05.152654 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.152570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/0.log"
Jul 09 17:40:05.152654 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.152624    2569 generic.go:356] "Generic (PLEG): container finished" podID="85cf20b4-45ae-412d-9f6b-83163c17afee" containerID="880dd5606be2667bfd1880960434aee3b11587c8f2658d4f062686b40843b39f" exitCode=255
Jul 09 17:40:05.152880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.152664    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vt7q5" event={"ID":"85cf20b4-45ae-412d-9f6b-83163c17afee","Type":"ContainerDied","Data":"880dd5606be2667bfd1880960434aee3b11587c8f2658d4f062686b40843b39f"}
Jul 09 17:40:05.153012 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.152996    2569 scope.go:117] "RemoveContainer" containerID="880dd5606be2667bfd1880960434aee3b11587c8f2658d4f062686b40843b39f"
Jul 09 17:40:05.154503 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.154444    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7" event={"ID":"8b0a5699-d24e-46c4-bfcf-6db4240b79dc","Type":"ContainerStarted","Data":"36ff412fd3aca62e6cce6975dd021de4d0876f20dd4fbe9e9cd32a141ec69e15"}
Jul 09 17:40:05.156234 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.156206    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk" event={"ID":"b7db9ab0-1686-44e0-9ad0-5496588b6eca","Type":"ContainerStarted","Data":"cec20a1b65a7e2dafb7f7d065f78ea03685e920dfb7a605a649018f5490a8ff6"}
Jul 09 17:40:05.157871 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.157850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx" event={"ID":"cca94c02-4238-466d-a7c5-e3150443423a","Type":"ContainerStarted","Data":"369d883b8085c0348177062fa5fad58fad1e51426fd4f6a78e556cde0a9fb179"}
Jul 09 17:40:05.187460 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.187411    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7" podStartSLOduration=1.589994474 podStartE2EDuration="6.187395452s" totalImagesPullingTime="4.597400978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:05.18702785 +0000 UTC m=+59.232324362" watchObservedRunningTime="2026-07-09 17:40:05.187395452 +0000 UTC m=+59.232691962"
Jul 09 17:40:05.207421 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.207369    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx" podStartSLOduration=1.739922339 podStartE2EDuration="6.207348068s" totalImagesPullingTime="4.467425729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:05.204549746 +0000 UTC m=+59.249846253" watchObservedRunningTime="2026-07-09 17:40:05.207348068 +0000 UTC m=+59.252644579"
Jul 09 17:40:05.232968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:05.232911    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk" podStartSLOduration=1.874716633 podStartE2EDuration="6.232891139s" totalImagesPullingTime="4.358174506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:05.23286713 +0000 UTC m=+59.278163637" watchObservedRunningTime="2026-07-09 17:40:05.232891139 +0000 UTC m=+59.278187651"
Jul 09 17:40:06.164244 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.164213    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:40:06.164823 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.164736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/0.log"
Jul 09 17:40:06.164823 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.164772    2569 generic.go:356] "Generic (PLEG): container finished" podID="85cf20b4-45ae-412d-9f6b-83163c17afee" containerID="00b0e76e8e2b1fbb4fd1815018a58af3074dbdf5978380948d25bceafbf92abf" exitCode=255
Jul 09 17:40:06.164934 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.164885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vt7q5" event={"ID":"85cf20b4-45ae-412d-9f6b-83163c17afee","Type":"ContainerDied","Data":"00b0e76e8e2b1fbb4fd1815018a58af3074dbdf5978380948d25bceafbf92abf"}
Jul 09 17:40:06.164988 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.164945    2569 scope.go:117] "RemoveContainer" containerID="880dd5606be2667bfd1880960434aee3b11587c8f2658d4f062686b40843b39f"
Jul 09 17:40:06.165274 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.165179    2569 scope.go:117] "RemoveContainer" containerID="00b0e76e8e2b1fbb4fd1815018a58af3074dbdf5978380948d25bceafbf92abf"
Jul 09 17:40:06.165382 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:06.165361    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vt7q5_openshift-console-operator(85cf20b4-45ae-412d-9f6b-83163c17afee)\"" pod="openshift-console-operator/console-operator-7866497494-vt7q5" podUID="85cf20b4-45ae-412d-9f6b-83163c17afee"
Jul 09 17:40:06.368158 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.368126    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zpv9t"]
Jul 09 17:40:06.400105 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.400072    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.402494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.402466    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2r4b\""
Jul 09 17:40:06.406699 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.406668    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 17:40:06.409265 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.409237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zpv9t"]
Jul 09 17:40:06.409454 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.409424    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 17:40:06.448104 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.447979    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:06.454146 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.454113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.454386 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.454363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8ngm\" (UniqueName: \"kubernetes.io/projected/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-api-access-q8ngm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.454506 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.454482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.456569 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.454555    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5acadce7-42a4-452f-9ca5-3f80ba7ce707-crio-socket\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.456569 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.454636    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5acadce7-42a4-452f-9ca5-3f80ba7ce707-data-volume\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.555846 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.555797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.555846 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.555851    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8ngm\" (UniqueName: \"kubernetes.io/projected/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-api-access-q8ngm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.556059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.555919    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.556059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.555965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5acadce7-42a4-452f-9ca5-3f80ba7ce707-crio-socket\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.556059 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:06.555964    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:06.556059 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:06.556000    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 17:40:06.556210 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.556060    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5acadce7-42a4-452f-9ca5-3f80ba7ce707-crio-socket\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.556210 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:06.556067    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:07.056048829 +0000 UTC m=+61.101345320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:06.556210 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.556111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5acadce7-42a4-452f-9ca5-3f80ba7ce707-data-volume\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.556210 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:06.556164    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:07.056152626 +0000 UTC m=+61.101449122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : configmap "kube-rbac-proxy" not found
Jul 09 17:40:06.556450 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.556432    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5acadce7-42a4-452f-9ca5-3f80ba7ce707-data-volume\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.576825 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.576787    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:06.586758 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.586729    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8ngm\" (UniqueName: \"kubernetes.io/projected/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-api-access-q8ngm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:06.769557 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.769439    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:06.848453 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.848417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:06.953271 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:06.953226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:07.060513 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.060429    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:07.060686 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.060588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:07.060686 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.060617    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:07.060798 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.060698    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:08.060676953 +0000 UTC m=+62.105973442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:07.060798 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.060701    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 17:40:07.060798 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.060752    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:08.060737761 +0000 UTC m=+62.106034249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : configmap "kube-rbac-proxy" not found
Jul 09 17:40:07.168889 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.168859    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:40:07.169278 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.169211    2569 scope.go:117] "RemoveContainer" containerID="00b0e76e8e2b1fbb4fd1815018a58af3074dbdf5978380948d25bceafbf92abf"
Jul 09 17:40:07.169386 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.169366    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vt7q5_openshift-console-operator(85cf20b4-45ae-412d-9f6b-83163c17afee)\"" pod="openshift-console-operator/console-operator-7866497494-vt7q5" podUID="85cf20b4-45ae-412d-9f6b-83163c17afee"
Jul 09 17:40:07.191299 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.191262    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:07.287623 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.287585    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:07.387720 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.387686    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:07.564119 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.564082    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:07.564343 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.564258    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 17:40:07.564418 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.564349    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls podName:f4b00349-f025-4284-9cb4-4db5801ccf9a nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.564327306 +0000 UTC m=+69.609623796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls") pod "cluster-samples-operator-65db858894-jtvnl" (UID: "f4b00349-f025-4284-9cb4-4db5801ccf9a") : secret "samples-operator-tls" not found
Jul 09 17:40:07.665554 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.665447    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:07.665696 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.665614    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:07.665696 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.665682    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls podName:c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.665665911 +0000 UTC m=+69.710962400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rnn78" (UID: "c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e") : secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:07.766363 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.766325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:07.766363 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:07.766367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:07.766632 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.766506    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.766487049 +0000 UTC m=+69.811783541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : configmap references non-existent config key: service-ca.crt
Jul 09 17:40:07.766632 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.766615    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 17:40:07.766729 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:07.766678    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:15.766666746 +0000 UTC m=+69.811963234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : secret "router-metrics-certs-default" not found
Jul 09 17:40:08.069094 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.068998    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:08.069275 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.069112    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:08.069275 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:08.069135    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 17:40:08.069275 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:08.069210    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:08.069275 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:08.069216    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:10.069192493 +0000 UTC m=+64.114488981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : configmap "kube-rbac-proxy" not found
Jul 09 17:40:08.069275 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:08.069249    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:10.069237915 +0000 UTC m=+64.114534404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:08.208717 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.208688    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9spw_caf69956-4806-45a0-8f7e-e61a98441332/dns-node-resolver/0.log"
Jul 09 17:40:08.715440 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.715404    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-npn7x"]
Jul 09 17:40:08.718067 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.718045    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.721685 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.721662    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 17:40:08.723454 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.723431    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 17:40:08.724019 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.723988    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 17:40:08.725940 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.725916    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t2tnb\""
Jul 09 17:40:08.726517 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.726496    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 17:40:08.735956 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.735928    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-npn7x"]
Jul 09 17:40:08.775291 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.775256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e1504ced-c880-4fd7-93d6-978d08d4ccd2-signing-key\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.775495 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.775347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g54bs\" (UniqueName: \"kubernetes.io/projected/e1504ced-c880-4fd7-93d6-978d08d4ccd2-kube-api-access-g54bs\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.775495 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.775443    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e1504ced-c880-4fd7-93d6-978d08d4ccd2-signing-cabundle\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.802767 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.802739    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdxkr_f8dc5e42-1b09-432e-827b-bd8ab962b3b4/node-ca/0.log"
Jul 09 17:40:08.803038 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.803013    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:08.876632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.876587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e1504ced-c880-4fd7-93d6-978d08d4ccd2-signing-cabundle\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.876810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.876655    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e1504ced-c880-4fd7-93d6-978d08d4ccd2-signing-key\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.876851 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.876831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g54bs\" (UniqueName: \"kubernetes.io/projected/e1504ced-c880-4fd7-93d6-978d08d4ccd2-kube-api-access-g54bs\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.877241 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.877214    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e1504ced-c880-4fd7-93d6-978d08d4ccd2-signing-cabundle\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.879049 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.879024    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e1504ced-c880-4fd7-93d6-978d08d4ccd2-signing-key\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.888835 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.888803    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g54bs\" (UniqueName: \"kubernetes.io/projected/e1504ced-c880-4fd7-93d6-978d08d4ccd2-kube-api-access-g54bs\") pod \"service-ca-79f68b9f4f-npn7x\" (UID: \"e1504ced-c880-4fd7-93d6-978d08d4ccd2\") " pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:08.891819 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:08.891787    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:09.028597 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:09.028502    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x"
Jul 09 17:40:09.069233 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:09.069201    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sc5lg"
Jul 09 17:40:09.174235 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:09.174201    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-npn7x"]
Jul 09 17:40:09.181088 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:09.181061    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1504ced_c880_4fd7_93d6_978d08d4ccd2.slice/crio-adbbf3d41c77814fbca9d4de81db0de0b5da6ba5779a345464cc2fd2608e2870 WatchSource:0}: Error finding container adbbf3d41c77814fbca9d4de81db0de0b5da6ba5779a345464cc2fd2608e2870: Status 404 returned error can't find the container with id adbbf3d41c77814fbca9d4de81db0de0b5da6ba5779a345464cc2fd2608e2870
Jul 09 17:40:09.254637 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:09.254593    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:09.353075 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:09.352983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:09.442187 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:09.442157    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:09.599762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:09.599738    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8qn5m_b929dd4c-b28c-43cc-9362-87d73002435d/serve-healthcheck-canary/0.log"
Jul 09 17:40:10.088349 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.088294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:10.088517 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.088467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:10.088517 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:10.088477    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:10.088669 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:10.088596    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 17:40:10.088669 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:10.088597    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:14.088570875 +0000 UTC m=+68.133867366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:10.088669 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:10.088657    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:14.088644648 +0000 UTC m=+68.133941137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : configmap "kube-rbac-proxy" not found
Jul 09 17:40:10.165188 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.165149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:10.180079 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.180048    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x" event={"ID":"e1504ced-c880-4fd7-93d6-978d08d4ccd2","Type":"ContainerStarted","Data":"6bedf9e0fd174b3dc9ea8ffae548d3273e9fee2dde019eab88132e6920536a77"}
Jul 09 17:40:10.180249 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.180095    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x" event={"ID":"e1504ced-c880-4fd7-93d6-978d08d4ccd2","Type":"ContainerStarted","Data":"adbbf3d41c77814fbca9d4de81db0de0b5da6ba5779a345464cc2fd2608e2870"}
Jul 09 17:40:10.207543 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.207466    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-npn7x" podStartSLOduration=2.207446443 podStartE2EDuration="2.207446443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:10.206508801 +0000 UTC m=+64.251805313" watchObservedRunningTime="2026-07-09 17:40:10.207446443 +0000 UTC m=+64.252742955"
Jul 09 17:40:10.207956 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.207937    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:10.208015 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.207986    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:10.208351 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.208339    2569 scope.go:117] "RemoveContainer" containerID="00b0e76e8e2b1fbb4fd1815018a58af3074dbdf5978380948d25bceafbf92abf"
Jul 09 17:40:10.208500 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:10.208483    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vt7q5_openshift-console-operator(85cf20b4-45ae-412d-9f6b-83163c17afee)\"" pod="openshift-console-operator/console-operator-7866497494-vt7q5" podUID="85cf20b4-45ae-412d-9f6b-83163c17afee"
Jul 09 17:40:10.835187 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.835150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:10.937032 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:10.936987    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:11.102672 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:11.102567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:11.206127 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:11.206095    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:11.407319 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:11.407271    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:12.390042 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.390006    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:12.410663 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.410624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:40:12.410801 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.410713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:40:12.413167 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.413148    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 17:40:12.413250 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.413207    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 17:40:12.420977 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:12.420953    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 17:40:12.421064 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:12.421024    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs podName:2e8195f6-2749-44b3-ab58-dfb07e57b84c nodeName:}" failed. No retries permitted until 2026-07-09 17:41:16.42100291 +0000 UTC m=+130.466299400 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs") pod "network-metrics-daemon-ggjz7" (UID: "2e8195f6-2749-44b3-ab58-dfb07e57b84c") : secret "metrics-daemon-secret" not found
Jul 09 17:40:12.423120 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.423089    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30b8805a-d5a8-4a0f-8334-96625dd051b1-original-pull-secret\") pod \"global-pull-secret-syncer-bzwv4\" (UID: \"30b8805a-d5a8-4a0f-8334-96625dd051b1\") " pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:40:12.512048 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.512013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:40:12.514447 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.514424    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 17:40:12.524688 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.524660    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 17:40:12.535468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.535431    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qhqt\" (UniqueName: \"kubernetes.io/projected/da37e445-bddb-4fe7-80ce-d4795c0c2042-kube-api-access-7qhqt\") pod \"network-check-target-whhxk\" (UID: \"da37e445-bddb-4fe7-80ce-d4795c0c2042\") " pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:40:12.609544 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.609501    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8d4pd\""
Jul 09 17:40:12.613561 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.613539    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzwv4"
Jul 09 17:40:12.617954 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.617934    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:40:12.705987 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.705943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:12.763019 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.762988    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzwv4"]
Jul 09 17:40:12.767952 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:12.767920    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b8805a_d5a8_4a0f_8334_96625dd051b1.slice/crio-c46d77e095a16ffb6b638e904c81a7456ca99dc81c12857ad52e8d9bed7bb287 WatchSource:0}: Error finding container c46d77e095a16ffb6b638e904c81a7456ca99dc81c12857ad52e8d9bed7bb287: Status 404 returned error can't find the container with id c46d77e095a16ffb6b638e904c81a7456ca99dc81c12857ad52e8d9bed7bb287
Jul 09 17:40:12.780790 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.780754    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whhxk"]
Jul 09 17:40:12.784339 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:12.784293    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda37e445_bddb_4fe7_80ce_d4795c0c2042.slice/crio-4b49e42680c97b19a189c2576b55ff56ddf83d4ac1646d56aad454e4a1721f49 WatchSource:0}: Error finding container 4b49e42680c97b19a189c2576b55ff56ddf83d4ac1646d56aad454e4a1721f49: Status 404 returned error can't find the container with id 4b49e42680c97b19a189c2576b55ff56ddf83d4ac1646d56aad454e4a1721f49
Jul 09 17:40:12.802799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.802765    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:12.983473 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:12.983375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:13.176768 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:13.176726    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:13.191240 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:13.191201    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whhxk" event={"ID":"da37e445-bddb-4fe7-80ce-d4795c0c2042","Type":"ContainerStarted","Data":"4b49e42680c97b19a189c2576b55ff56ddf83d4ac1646d56aad454e4a1721f49"}
Jul 09 17:40:13.192442 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:13.192402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzwv4" event={"ID":"30b8805a-d5a8-4a0f-8334-96625dd051b1","Type":"ContainerStarted","Data":"c46d77e095a16ffb6b638e904c81a7456ca99dc81c12857ad52e8d9bed7bb287"}
Jul 09 17:40:13.391872 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:13.391827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:14.129726 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.129680    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:14.129906 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:14.129825    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 17:40:14.129906 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.129836    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:14.130027 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:14.129925    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:22.129902575 +0000 UTC m=+76.175199070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : configmap "kube-rbac-proxy" not found
Jul 09 17:40:14.130027 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:14.129973    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:14.130027 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:14.130022    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls podName:5acadce7-42a4-452f-9ca5-3f80ba7ce707 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:22.130005758 +0000 UTC m=+76.175302252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpv9t" (UID: "5acadce7-42a4-452f-9ca5-3f80ba7ce707") : secret "insights-runtime-extractor-tls" not found
Jul 09 17:40:14.343650 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.343614    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:14.428370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.428281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:14.604258 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.604211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:14.710289 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.710193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:14.810759 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.810711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:14.972655 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:14.972509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:15.240358 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.240262    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:40:15.243617 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.243590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"image-registry-5855f948f7-462wj\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") " pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:40:15.340980 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.340934    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:40:15.343913 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.343853    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a-metrics-tls\") pod \"dns-default-d4dmb\" (UID: \"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a\") " pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:40:15.491168 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.491083    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5d6lq\""
Jul 09 17:40:15.498288 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.498256    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:40:15.501927 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.501883    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dxrqg\""
Jul 09 17:40:15.509921 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.509889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:40:15.643722 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.643675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:15.646875 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.646832    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4b00349-f025-4284-9cb4-4db5801ccf9a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-jtvnl\" (UID: \"f4b00349-f025-4284-9cb4-4db5801ccf9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:15.744779 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.744676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:15.744960 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:15.744841    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:15.744960 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:15.744926    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls podName:c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e nodeName:}" failed. No retries permitted until 2026-07-09 17:40:31.744904657 +0000 UTC m=+85.790201157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rnn78" (UID: "c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e") : secret "cluster-monitoring-operator-tls" not found
Jul 09 17:40:15.752735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.752702    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vkd8j\""
Jul 09 17:40:15.761591 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.761553    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"
Jul 09 17:40:15.789707 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.789669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:15.845955 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.845916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:15.846151 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.845970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:15.846151 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:15.846118    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle podName:747e8e45-5c52-4275-baa8-3218cdbfb8e8 nodeName:}" failed. No retries permitted until 2026-07-09 17:40:31.846095902 +0000 UTC m=+85.891392406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle") pod "router-default-5bc67f59d-8gfgw" (UID: "747e8e45-5c52-4275-baa8-3218cdbfb8e8") : configmap references non-existent config key: service-ca.crt
Jul 09 17:40:15.849784 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:15.849754    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/747e8e45-5c52-4275-baa8-3218cdbfb8e8-metrics-certs\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:16.248842 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:16.248793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:16.586384 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:16.586288    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:16.778263 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:16.778222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:16.842135 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:16.842039    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:17.216171 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:17.216132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:17.739458 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:17.739415    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl"]
Jul 09 17:40:17.754811 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:17.754770    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d4dmb"]
Jul 09 17:40:17.758043 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:17.758009    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa2e5ce_d1d2_4674_9e2a_0ed2f7c14e2a.slice/crio-6f700401fa136262a8ec94d95a762b142d73069530879d9359d4b0a34a5b12cf WatchSource:0}: Error finding container 6f700401fa136262a8ec94d95a762b142d73069530879d9359d4b0a34a5b12cf: Status 404 returned error can't find the container with id 6f700401fa136262a8ec94d95a762b142d73069530879d9359d4b0a34a5b12cf
Jul 09 17:40:17.774073 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:17.774041    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5855f948f7-462wj"]
Jul 09 17:40:17.778280 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:17.778240    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cb2478_62d9_4880_862e_68300e64fbdb.slice/crio-70781e5687b1eae53fd7cf8ad6157dd2b54f368bde1aed03f47eb36603440c08 WatchSource:0}: Error finding container 70781e5687b1eae53fd7cf8ad6157dd2b54f368bde1aed03f47eb36603440c08: Status 404 returned error can't find the container with id 70781e5687b1eae53fd7cf8ad6157dd2b54f368bde1aed03f47eb36603440c08
Jul 09 17:40:17.973060 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:17.973029    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:18.181997 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.181956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:18.213847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.213801    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whhxk" event={"ID":"da37e445-bddb-4fe7-80ce-d4795c0c2042","Type":"ContainerStarted","Data":"0fccb80c8f046764a97f89bf5db829f59d8309119b5f4a924ce98c0e180d1cb7"}
Jul 09 17:40:18.214053 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.213930    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:40:18.215245 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.215215    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4dmb" event={"ID":"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a","Type":"ContainerStarted","Data":"6f700401fa136262a8ec94d95a762b142d73069530879d9359d4b0a34a5b12cf"}
Jul 09 17:40:18.216915 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.216890    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzwv4" event={"ID":"30b8805a-d5a8-4a0f-8334-96625dd051b1","Type":"ContainerStarted","Data":"7c2346bf6ed08f98c54fd5b599007c597051f06bfe633065edf3fcae4c551aff"}
Jul 09 17:40:18.219042 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.219015    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855f948f7-462wj" event={"ID":"c0cb2478-62d9-4880-862e-68300e64fbdb","Type":"ContainerStarted","Data":"391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc"}
Jul 09 17:40:18.219175 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.219061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855f948f7-462wj" event={"ID":"c0cb2478-62d9-4880-862e-68300e64fbdb","Type":"ContainerStarted","Data":"70781e5687b1eae53fd7cf8ad6157dd2b54f368bde1aed03f47eb36603440c08"}
Jul 09 17:40:18.219175 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.219105    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:40:18.220427 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.220393    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl" event={"ID":"f4b00349-f025-4284-9cb4-4db5801ccf9a","Type":"ContainerStarted","Data":"bfcc436bc623c2ad2634a76da80b666b6e315b2613599e5f9454ce95a91d7407"}
Jul 09 17:40:18.253541 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.253458    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-whhxk" podStartSLOduration=66.500846256 podStartE2EDuration="1m11.25342547s" totalImagesPullingTime="4.752579214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:18.233582049 +0000 UTC m=+72.278878563" watchObservedRunningTime="2026-07-09 17:40:18.25342547 +0000 UTC m=+72.298721983"
Jul 09 17:40:18.255038 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.254488    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5855f948f7-462wj" podStartSLOduration=71.254474099 podStartE2EDuration="1m11.254474099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:18.253218701 +0000 UTC m=+72.298515202" watchObservedRunningTime="2026-07-09 17:40:18.254474099 +0000 UTC m=+72.299770612"
Jul 09 17:40:18.381190 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.381015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:18.781079 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:18.781034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:19.174085 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:19.174038    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:19.614489 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:19.614331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:19.771233 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:19.771175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:20.178951 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:20.178914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:20.377767 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:20.377729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:21.012966 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.012874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:21.194307 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.194266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:21.231894 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.231854    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl" event={"ID":"f4b00349-f025-4284-9cb4-4db5801ccf9a","Type":"ContainerStarted","Data":"ff2bd39627d3749544a02a0456e0fd6d2438107c9b04ca70d6b75edf27f2fe0d"}
Jul 09 17:40:21.232075 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.231934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl" event={"ID":"f4b00349-f025-4284-9cb4-4db5801ccf9a","Type":"ContainerStarted","Data":"78d878bb2e0dad53d44f5e2f73f5b4dfde62f69cd8d04f359d8a1e71b353199e"}
Jul 09 17:40:21.233644 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.233619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4dmb" event={"ID":"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a","Type":"ContainerStarted","Data":"23b22bb03b120df55316169e98aaaf81ceceea6893c2b0b11a894ad9ff59474b"}
Jul 09 17:40:21.233762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.233662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4dmb" event={"ID":"6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a","Type":"ContainerStarted","Data":"4b78c36f6f3571990462474732e5d65933c5ea57889e46a77b0768beafa3c3e9"}
Jul 09 17:40:21.233762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.233741    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:40:21.259291 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.259238    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bzwv4" podStartSLOduration=69.477882605 podStartE2EDuration="1m14.259217436s" totalImagesPullingTime="4.781334831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:18.270399393 +0000 UTC m=+72.315695905" watchObservedRunningTime="2026-07-09 17:40:21.259217436 +0000 UTC m=+75.304513968"
Jul 09 17:40:21.281397 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.281257    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d4dmb" podStartSLOduration=35.558112894 podStartE2EDuration="38.281238783s" totalImagesPullingTime="2.723125889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:21.28061027 +0000 UTC m=+75.325906780" watchObservedRunningTime="2026-07-09 17:40:21.281238783 +0000 UTC m=+75.326535293"
Jul 09 17:40:21.282207 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.282165    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-jtvnl" podStartSLOduration=19.602327824 podStartE2EDuration="22.282151814s" totalImagesPullingTime="2.67982399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:21.258890882 +0000 UTC m=+75.304187393" watchObservedRunningTime="2026-07-09 17:40:21.282151814 +0000 UTC m=+75.327448337"
Jul 09 17:40:21.388655 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.388626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:21.488875 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.488825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:21.589126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.589024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:21.755799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:21.755763    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:22.203445 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:22.203403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:22.203861 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:22.203490    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:22.203983 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:22.203956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5acadce7-42a4-452f-9ca5-3f80ba7ce707-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:22.205847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:22.205824    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5acadce7-42a4-452f-9ca5-3f80ba7ce707-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpv9t\" (UID: \"5acadce7-42a4-452f-9ca5-3f80ba7ce707\") " pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:22.312298 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:22.312257    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zpv9t"
Jul 09 17:40:22.448800 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:22.448766    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zpv9t"]
Jul 09 17:40:22.452146 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:22.452120    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acadce7_42a4_452f_9ca5_3f80ba7ce707.slice/crio-fbdfa4746e36c973e579a1472b839916db5fc171cfd3ef78efb83a3edde90d43 WatchSource:0}: Error finding container fbdfa4746e36c973e579a1472b839916db5fc171cfd3ef78efb83a3edde90d43: Status 404 returned error can't find the container with id fbdfa4746e36c973e579a1472b839916db5fc171cfd3ef78efb83a3edde90d43
Jul 09 17:40:23.243768 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:23.243726    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpv9t" event={"ID":"5acadce7-42a4-452f-9ca5-3f80ba7ce707","Type":"ContainerStarted","Data":"fbdfa4746e36c973e579a1472b839916db5fc171cfd3ef78efb83a3edde90d43"}
Jul 09 17:40:25.494900 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:25.494863    2569 scope.go:117] "RemoveContainer" containerID="00b0e76e8e2b1fbb4fd1815018a58af3074dbdf5978380948d25bceafbf92abf"
Jul 09 17:40:27.261012 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.260920    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpv9t" event={"ID":"5acadce7-42a4-452f-9ca5-3f80ba7ce707","Type":"ContainerStarted","Data":"827561193cbf26a1c04a30b53c5212639e050e56e4a46e68fc4dcf68a420944e"}
Jul 09 17:40:27.262859 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.262838    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:40:27.263005 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.262912    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vt7q5" event={"ID":"85cf20b4-45ae-412d-9f6b-83163c17afee","Type":"ContainerStarted","Data":"90a46f9d9d6ac5e028c5f8513024510392f03c5a9b4dfcd52b98cbe949b285e1"}
Jul 09 17:40:27.263278 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.263257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:27.284064 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.284008    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-vt7q5" podStartSLOduration=23.883156612 podStartE2EDuration="28.28399235s" totalImagesPullingTime="4.400835738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:27.283227071 +0000 UTC m=+81.328523584" watchObservedRunningTime="2026-07-09 17:40:27.28399235 +0000 UTC m=+81.329288860"
Jul 09 17:40:27.468208 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.468136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-vt7q5"
Jul 09 17:40:27.703978 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.703938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:27.798545 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.798498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:27.959501 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:27.959410    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:28.274494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.274408    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpv9t" event={"ID":"5acadce7-42a4-452f-9ca5-3f80ba7ce707","Type":"ContainerStarted","Data":"fc5effe0aa3ac9b68c0c1a587cce5251dc7f0de9c0ee25d908756b37c8de3ce4"}
Jul 09 17:40:28.410040 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.409887    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"]
Jul 09 17:40:28.413076 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.413051    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"
Jul 09 17:40:28.424267 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:28.424227    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"network-check-source-869dcfcdcd-kns7z\" is forbidden: User \"system:node:ip-10-0-141-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-141-118.ec2.internal' and this object" podUID="81ee63e6-28ec-475b-9914-fdbf5b568f3e" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"
Jul 09 17:40:28.424424 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:40:28.424273    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"network-diagnostics-dockercfg-96c5t\" is forbidden: User \"system:node:ip-10-0-141-118.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-141-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-96c5t\"" type="*v1.Secret"
Jul 09 17:40:28.425406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.425377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:28.450056 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.450021    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"]
Jul 09 17:40:28.509709 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.509670    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"]
Jul 09 17:40:28.513287 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.513256    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.516912 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.516878    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 17:40:28.517543 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.517498    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 17:40:28.517679 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.517616    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ztftj\""
Jul 09 17:40:28.532697 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.532619    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"]
Jul 09 17:40:28.563415 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.563376    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxk5c\" (UniqueName: \"kubernetes.io/projected/81ee63e6-28ec-475b-9914-fdbf5b568f3e-kube-api-access-zxk5c\") pod \"network-check-source-869dcfcdcd-kns7z\" (UID: \"81ee63e6-28ec-475b-9914-fdbf5b568f3e\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"
Jul 09 17:40:28.595493 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.595460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:28.615707 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.615658    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-54pcn"]
Jul 09 17:40:28.619195 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.619167    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-54pcn"
Jul 09 17:40:28.621861 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.621830    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 17:40:28.622316 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.622291    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 17:40:28.622457 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.622434    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v86xm\""
Jul 09 17:40:28.632075 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.632045    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-54pcn"]
Jul 09 17:40:28.665063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.665013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxk5c\" (UniqueName: \"kubernetes.io/projected/81ee63e6-28ec-475b-9914-fdbf5b568f3e-kube-api-access-zxk5c\") pod \"network-check-source-869dcfcdcd-kns7z\" (UID: \"81ee63e6-28ec-475b-9914-fdbf5b568f3e\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"
Jul 09 17:40:28.665239 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.665146    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/67897b52-e166-44e1-8b12-ab469929a925-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w5vzg\" (UID: \"67897b52-e166-44e1-8b12-ab469929a925\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.665239 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.665195    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67897b52-e166-44e1-8b12-ab469929a925-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w5vzg\" (UID: \"67897b52-e166-44e1-8b12-ab469929a925\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.676740 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.676709    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxk5c\" (UniqueName: \"kubernetes.io/projected/81ee63e6-28ec-475b-9914-fdbf5b568f3e-kube-api-access-zxk5c\") pod \"network-check-source-869dcfcdcd-kns7z\" (UID: \"81ee63e6-28ec-475b-9914-fdbf5b568f3e\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"
Jul 09 17:40:28.698788 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.698750    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:28.765830 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.765792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67897b52-e166-44e1-8b12-ab469929a925-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w5vzg\" (UID: \"67897b52-e166-44e1-8b12-ab469929a925\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.765997 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.765857    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58gsh\" (UniqueName: \"kubernetes.io/projected/fb09350d-c6ab-44ab-aea7-64ac2bb69914-kube-api-access-58gsh\") pod \"downloads-68c9cbb497-54pcn\" (UID: \"fb09350d-c6ab-44ab-aea7-64ac2bb69914\") " pod="openshift-console/downloads-68c9cbb497-54pcn"
Jul 09 17:40:28.765997 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.765938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/67897b52-e166-44e1-8b12-ab469929a925-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w5vzg\" (UID: \"67897b52-e166-44e1-8b12-ab469929a925\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.766693 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.766667    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/67897b52-e166-44e1-8b12-ab469929a925-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w5vzg\" (UID: \"67897b52-e166-44e1-8b12-ab469929a925\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.768734 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.768707    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67897b52-e166-44e1-8b12-ab469929a925-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w5vzg\" (UID: \"67897b52-e166-44e1-8b12-ab469929a925\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.781871 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.781832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:28.825748 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.825664    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"
Jul 09 17:40:28.867324 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.867292    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58gsh\" (UniqueName: \"kubernetes.io/projected/fb09350d-c6ab-44ab-aea7-64ac2bb69914-kube-api-access-58gsh\") pod \"downloads-68c9cbb497-54pcn\" (UID: \"fb09350d-c6ab-44ab-aea7-64ac2bb69914\") " pod="openshift-console/downloads-68c9cbb497-54pcn"
Jul 09 17:40:28.877429 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.877387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:28.879769 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.879741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58gsh\" (UniqueName: \"kubernetes.io/projected/fb09350d-c6ab-44ab-aea7-64ac2bb69914-kube-api-access-58gsh\") pod \"downloads-68c9cbb497-54pcn\" (UID: \"fb09350d-c6ab-44ab-aea7-64ac2bb69914\") " pod="openshift-console/downloads-68c9cbb497-54pcn"
Jul 09 17:40:28.932705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.932128    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-54pcn"
Jul 09 17:40:28.986649 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:28.986589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w5vzg"]
Jul 09 17:40:28.992012 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:28.991971    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67897b52_e166_44e1_8b12_ab469929a925.slice/crio-3002861ad167b35d43f06dbaf1ae7641607626af1f4124c0b7bb79fa312dfcab WatchSource:0}: Error finding container 3002861ad167b35d43f06dbaf1ae7641607626af1f4124c0b7bb79fa312dfcab: Status 404 returned error can't find the container with id 3002861ad167b35d43f06dbaf1ae7641607626af1f4124c0b7bb79fa312dfcab
Jul 09 17:40:29.090129 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.089881    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-54pcn"]
Jul 09 17:40:29.093124 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:29.093083    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb09350d_c6ab_44ab_aea7_64ac2bb69914.slice/crio-39428a0f3b73dfb4386cb8a0f417188dc2ca2b5d038a9cd84b95c406561ac307 WatchSource:0}: Error finding container 39428a0f3b73dfb4386cb8a0f417188dc2ca2b5d038a9cd84b95c406561ac307: Status 404 returned error can't find the container with id 39428a0f3b73dfb4386cb8a0f417188dc2ca2b5d038a9cd84b95c406561ac307
Jul 09 17:40:29.280393 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.280347    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-54pcn" event={"ID":"fb09350d-c6ab-44ab-aea7-64ac2bb69914","Type":"ContainerStarted","Data":"39428a0f3b73dfb4386cb8a0f417188dc2ca2b5d038a9cd84b95c406561ac307"}
Jul 09 17:40:29.281753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.281721    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg" event={"ID":"67897b52-e166-44e1-8b12-ab469929a925","Type":"ContainerStarted","Data":"3002861ad167b35d43f06dbaf1ae7641607626af1f4124c0b7bb79fa312dfcab"}
Jul 09 17:40:29.386619 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.386583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:29.545674 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.545633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:29.724044 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.723957    2569 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Jul 09 17:40:29.724044 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.724028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"
Jul 09 17:40:29.760006 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.759950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:29.826095 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:29.826041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:30.027264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:30.027188    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-96c5t\""
Jul 09 17:40:30.351521 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:30.351426    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:30.567762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:30.566914    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z"]
Jul 09 17:40:31.240228 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.240196    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d4dmb"
Jul 09 17:40:31.294134 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.294094    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpv9t" event={"ID":"5acadce7-42a4-452f-9ca5-3f80ba7ce707","Type":"ContainerStarted","Data":"924025060c29ef1c69740ee5213a03615260f62cb74a8abaec5f2121a5dfbec0"}
Jul 09 17:40:31.295923 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.295888    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z" event={"ID":"81ee63e6-28ec-475b-9914-fdbf5b568f3e","Type":"ContainerStarted","Data":"231750b9cc0dc2c352e95523a977d270f9fb4caa7566203414c2393c7eb327bf"}
Jul 09 17:40:31.296064 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.295934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z" event={"ID":"81ee63e6-28ec-475b-9914-fdbf5b568f3e","Type":"ContainerStarted","Data":"8fd8632adf2a94ad33352a21a56261fe3bf17d28fdcddd58d6edf721400e20c9"}
Jul 09 17:40:31.313859 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.313797    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zpv9t" podStartSLOduration=17.42344337 podStartE2EDuration="25.313774316s" totalImagesPullingTime="7.890330946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:40:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:31.313568361 +0000 UTC m=+85.358864870" watchObservedRunningTime="2026-07-09 17:40:31.313774316 +0000 UTC m=+85.359070822"
Jul 09 17:40:31.329447 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.329370    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kns7z" podStartSLOduration=3.32934962 podStartE2EDuration="3.32934962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:31.327772102 +0000 UTC m=+85.373068614" watchObservedRunningTime="2026-07-09 17:40:31.32934962 +0000 UTC m=+85.374646134"
Jul 09 17:40:31.798718 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.798675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:31.801405 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.801375    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rnn78\" (UID: \"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:31.899699 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.899658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:31.900448 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:31.900418    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/747e8e45-5c52-4275-baa8-3218cdbfb8e8-service-ca-bundle\") pod \"router-default-5bc67f59d-8gfgw\" (UID: \"747e8e45-5c52-4275-baa8-3218cdbfb8e8\") " pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:32.061178 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.061069    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ff9nf\""
Jul 09 17:40:32.068990 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.068955    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"
Jul 09 17:40:32.105119 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.105084    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vc5pp\""
Jul 09 17:40:32.113941 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.113908    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:32.118257 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.118183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:32.218905 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.218830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:32.253867 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.253828    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78"]
Jul 09 17:40:32.258201 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:32.258157    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc652f783_f4d9_4e3c_a0ec_3ed13c0fe80e.slice/crio-631ed5ee82f690dd14027e2502dd0cdb4bc6dda18827a2164c898e41b2f45c8f WatchSource:0}: Error finding container 631ed5ee82f690dd14027e2502dd0cdb4bc6dda18827a2164c898e41b2f45c8f: Status 404 returned error can't find the container with id 631ed5ee82f690dd14027e2502dd0cdb4bc6dda18827a2164c898e41b2f45c8f
Jul 09 17:40:32.284865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.284826    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc67f59d-8gfgw"]
Jul 09 17:40:32.287373 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:32.287347    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747e8e45_5c52_4275_baa8_3218cdbfb8e8.slice/crio-be51dfe7c36a273f1c84bdcb935e32ace49a7b98e58fcb18f61f976cccda56a6 WatchSource:0}: Error finding container be51dfe7c36a273f1c84bdcb935e32ace49a7b98e58fcb18f61f976cccda56a6: Status 404 returned error can't find the container with id be51dfe7c36a273f1c84bdcb935e32ace49a7b98e58fcb18f61f976cccda56a6
Jul 09 17:40:32.302053 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.302006    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc67f59d-8gfgw" event={"ID":"747e8e45-5c52-4275-baa8-3218cdbfb8e8","Type":"ContainerStarted","Data":"be51dfe7c36a273f1c84bdcb935e32ace49a7b98e58fcb18f61f976cccda56a6"}
Jul 09 17:40:32.304270 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.304001    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg" event={"ID":"67897b52-e166-44e1-8b12-ab469929a925","Type":"ContainerStarted","Data":"67feaa1001ca50aa35d2a516322b5cc32618ee271f74d5439a3218952e42448a"}
Jul 09 17:40:32.305678 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.305647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78" event={"ID":"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e","Type":"ContainerStarted","Data":"631ed5ee82f690dd14027e2502dd0cdb4bc6dda18827a2164c898e41b2f45c8f"}
Jul 09 17:40:32.322226 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.322115    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5vzg" podStartSLOduration=1.981310854 podStartE2EDuration="4.322087999s" totalImagesPullingTime="2.340777145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:32.320840703 +0000 UTC m=+86.366137215" watchObservedRunningTime="2026-07-09 17:40:32.322087999 +0000 UTC m=+86.367384511"
Jul 09 17:40:32.440488 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.440448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:32.543353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.543269    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:32.641113 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:32.641054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:33.311901 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:33.311858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc67f59d-8gfgw" event={"ID":"747e8e45-5c52-4275-baa8-3218cdbfb8e8","Type":"ContainerStarted","Data":"82d6e84c871d8fc022f5b0e409d2e10d6072cf496e4ffe69b0e944a140a2f824"}
Jul 09 17:40:33.341737 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:33.341666    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bc67f59d-8gfgw" podStartSLOduration=34.341647079 podStartE2EDuration="34.341647079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:33.34035685 +0000 UTC m=+87.385653361" watchObservedRunningTime="2026-07-09 17:40:33.341647079 +0000 UTC m=+87.386943569"
Jul 09 17:40:33.402799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:33.402759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:33.514198 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:33.514129    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:34.114500 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:34.114424    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:34.117164 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:34.117138    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:34.316180 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:34.316146    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:34.317728 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:34.317684    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bc67f59d-8gfgw"
Jul 09 17:40:34.726972 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:34.726880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:34.826365 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:34.826322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.012948 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.012800    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.101760 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.101664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.274978 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.274891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.322910 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.322869    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78" event={"ID":"c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e","Type":"ContainerStarted","Data":"c8421890aa6d180456c9bd0ced77fa5124aa72a2fcf938816c6f73606f07889e"}
Jul 09 17:40:35.341734 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.341675    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rnn78" podStartSLOduration=34.295436459 podStartE2EDuration="36.341654456s" totalImagesPullingTime="2.046217997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:35.340279875 +0000 UTC m=+89.385576391" watchObservedRunningTime="2026-07-09 17:40:35.341654456 +0000 UTC m=+89.386950965"
Jul 09 17:40:35.503794 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.503751    2569 patch_prober.go:28] interesting pod/image-registry-5855f948f7-462wj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 17:40:35.503958 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.503814    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5855f948f7-462wj" podUID="c0cb2478-62d9-4880-862e-68300e64fbdb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 17:40:35.783295 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.783246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:35.865137 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:35.865097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:36.841001 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:36.840960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:37.188419 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:37.188384    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:38.889988 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:38.889947    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:38.989838 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:38.989747    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:39.229354 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:39.229275    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:40:39.652467 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:39.652428    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:39.772190 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:39.772151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:40.299584 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:40.299504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:40.460667 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:40.460629    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:40.595686 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:40.595591    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:41.098025 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:41.097980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:41.215270 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:41.215234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:41.383042 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:41.383002    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:43.944437 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:43.944387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:44.052719 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:44.052674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:44.178572 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:44.178497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:44.279791 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:44.279698    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:45.271566 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:45.271510    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:45.357367 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:45.357257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:46.312863 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.312825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:46.567859 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.567761    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:46.692257 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.692220    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tjnk7"]
Jul 09 17:40:46.706612 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.706575    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.709858 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.709836    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 17:40:46.712996 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.712969    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 17:40:46.713147 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.713042    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tbd5w\""
Jul 09 17:40:46.713603 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.713316    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 17:40:46.713788 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.713771    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 17:40:46.716545 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.716506    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:46.802131 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.802079    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:46.836477 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-sys\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836477 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-wtmp\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-textfile\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-tls\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836665 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-root\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836671    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836700    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvjk\" (UniqueName: \"kubernetes.io/projected/45a39db7-7757-467c-b318-991f4eabd056-kube-api-access-hlvjk\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.836810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.836764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a39db7-7757-467c-b318-991f4eabd056-metrics-client-ca\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.937743 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.937691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a39db7-7757-467c-b318-991f4eabd056-metrics-client-ca\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.937922 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.937768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-sys\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.937922 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.937796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-wtmp\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.937922 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.937826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-textfile\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.937922 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.937886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-tls\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938141 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.937931    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938141 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.937999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-root\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938141 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-wtmp\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938141 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938030    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938141 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938047    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvjk\" (UniqueName: \"kubernetes.io/projected/45a39db7-7757-467c-b318-991f4eabd056-kube-api-access-hlvjk\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938388 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-textfile\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938388 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938194    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-root\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938488 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938403    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a39db7-7757-467c-b318-991f4eabd056-metrics-client-ca\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938488 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a39db7-7757-467c-b318-991f4eabd056-sys\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.938651 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.938630    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.940515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.940489    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-tls\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.940642 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.940558    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a39db7-7757-467c-b318-991f4eabd056-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:46.949875 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:46.949845    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvjk\" (UniqueName: \"kubernetes.io/projected/45a39db7-7757-467c-b318-991f4eabd056-kube-api-access-hlvjk\") pod \"node-exporter-tjnk7\" (UID: \"45a39db7-7757-467c-b318-991f4eabd056\") " pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:47.016122 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.016079    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjnk7"
Jul 09 17:40:47.043418 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:47.043370    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a39db7_7757_467c_b318_991f4eabd056.slice/crio-76f333c1f290dc6c708186a8facc63baa70d16500f93e610ef58bda1de0c0735 WatchSource:0}: Error finding container 76f333c1f290dc6c708186a8facc63baa70d16500f93e610ef58bda1de0c0735: Status 404 returned error can't find the container with id 76f333c1f290dc6c708186a8facc63baa70d16500f93e610ef58bda1de0c0735
Jul 09 17:40:47.098972 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.098934    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:47.256200 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.256164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:47.372079 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.371982    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-54pcn" event={"ID":"fb09350d-c6ab-44ab-aea7-64ac2bb69914","Type":"ContainerStarted","Data":"8fb4e34decd3a4b680e19c63f1b07d3989a1f182871e600ce5cf8c748f43ea66"}
Jul 09 17:40:47.372603 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.372466    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-54pcn"
Jul 09 17:40:47.374223 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.374185    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjnk7" event={"ID":"45a39db7-7757-467c-b318-991f4eabd056","Type":"ContainerStarted","Data":"76f333c1f290dc6c708186a8facc63baa70d16500f93e610ef58bda1de0c0735"}
Jul 09 17:40:47.386566 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.386517    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-54pcn"
Jul 09 17:40:47.428193 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.428126    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-54pcn" podStartSLOduration=1.451096416 podStartE2EDuration="19.428102793s" totalImagesPullingTime="17.977006377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:47.394153213 +0000 UTC m=+101.439449725" watchObservedRunningTime="2026-07-09 17:40:47.428102793 +0000 UTC m=+101.473399306"
Jul 09 17:40:47.653604 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.653564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:47.842550 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:47.839436    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:48.358132 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:48.358093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:48.459685 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:48.459646    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:49.227504 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:49.227469    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-whhxk"
Jul 09 17:40:49.387203 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:49.387156    2569 generic.go:356] "Generic (PLEG): container finished" podID="45a39db7-7757-467c-b318-991f4eabd056" containerID="61959b65bd74a1b49c3806888bfac6b001d4d72781a4c0210ec5a578c8b886c9" exitCode=0
Jul 09 17:40:49.387815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:49.387784    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjnk7" event={"ID":"45a39db7-7757-467c-b318-991f4eabd056","Type":"ContainerDied","Data":"61959b65bd74a1b49c3806888bfac6b001d4d72781a4c0210ec5a578c8b886c9"}
Jul 09 17:40:49.865630 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:49.865455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:49.966761 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:49.966720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:50.079170 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:50.079127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:50.394039 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:50.393992    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjnk7" event={"ID":"45a39db7-7757-467c-b318-991f4eabd056","Type":"ContainerStarted","Data":"1792be1647f9fbb031d8033ee26368b68b74fec29021962a36c44dce57a2f9bc"}
Jul 09 17:40:50.394224 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:50.394104    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjnk7" event={"ID":"45a39db7-7757-467c-b318-991f4eabd056","Type":"ContainerStarted","Data":"b629f40f0847a94144c2733f9b1f8be3d73a819b816309d0ecab60972209f38f"}
Jul 09 17:40:50.408919 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:50.408880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:50.418085 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:50.418015    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tjnk7" podStartSLOduration=2.825703677 podStartE2EDuration="4.417990792s" totalImagesPullingTime="1.477932138s" totalInitContainerRuntime="114.354977ms" isStatefulPod=true podCreationTimestamp="2026-07-09 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:50.417826419 +0000 UTC m=+104.463122931" watchObservedRunningTime="2026-07-09 17:40:50.417990792 +0000 UTC m=+104.463287303"
Jul 09 17:40:51.127682 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:51.127641    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5855f948f7-462wj"]
Jul 09 17:40:51.323711 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:51.323672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:51.438405 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:51.438314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:51.519454 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:51.519368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:51.845471 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:51.845380    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:52.375864 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.375821    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5798b55656-wvdnj"]
Jul 09 17:40:52.441797 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.441745    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5798b55656-wvdnj"]
Jul 09 17:40:52.441973 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.441880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.444516 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.444461    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 17:40:52.444516 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.444487    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 17:40:52.444810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.444745    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 17:40:52.445305 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.445279    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 17:40:52.445305 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.445290    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 17:40:52.445545 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.445364    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-76l56\""
Jul 09 17:40:52.453244 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.453197    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 17:40:52.594063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.594019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-oauth-serving-cert\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.594277 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.594079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-serving-cert\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.594277 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.594114    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dffkd\" (UniqueName: \"kubernetes.io/projected/8cce8a27-84c6-4c18-a89f-636fd3bc697f-kube-api-access-dffkd\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.594406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.594318    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-oauth-config\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.594406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.594384    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-service-ca\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.594504 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.594460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-config\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.594648 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.594518    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-trusted-ca-bundle\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.695404 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.695315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-trusted-ca-bundle\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.695634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.695410    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-oauth-serving-cert\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.695634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.695449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-serving-cert\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.695634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.695479    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dffkd\" (UniqueName: \"kubernetes.io/projected/8cce8a27-84c6-4c18-a89f-636fd3bc697f-kube-api-access-dffkd\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.695634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.695507    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-oauth-config\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.695634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.695577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-service-ca\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.695634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.695621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-config\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.696450 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.696395    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-service-ca\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.696732 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.696704    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-oauth-serving-cert\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.697008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.696987    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-config\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.697642 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.697616    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-trusted-ca-bundle\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.698578 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.698557    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-oauth-config\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.698687 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.698669    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-serving-cert\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.704383 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.704356    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dffkd\" (UniqueName: \"kubernetes.io/projected/8cce8a27-84c6-4c18-a89f-636fd3bc697f-kube-api-access-dffkd\") pod \"console-5798b55656-wvdnj\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") " pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.755397 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.755307    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:40:52.999903 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:52.999870    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5798b55656-wvdnj"]
Jul 09 17:40:53.002915 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:40:53.002879    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cce8a27_84c6_4c18_a89f_636fd3bc697f.slice/crio-6b1f1cbc2dc2b620d794d093ce319f1aeba69dcf4e29a079ead87826e3c6c432 WatchSource:0}: Error finding container 6b1f1cbc2dc2b620d794d093ce319f1aeba69dcf4e29a079ead87826e3c6c432: Status 404 returned error can't find the container with id 6b1f1cbc2dc2b620d794d093ce319f1aeba69dcf4e29a079ead87826e3c6c432
Jul 09 17:40:53.307196 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:53.307103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:53.408780 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:53.408744    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5798b55656-wvdnj" event={"ID":"8cce8a27-84c6-4c18-a89f-636fd3bc697f","Type":"ContainerStarted","Data":"6b1f1cbc2dc2b620d794d093ce319f1aeba69dcf4e29a079ead87826e3c6c432"}
Jul 09 17:40:53.409514 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:53.409483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:56.805847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:56.805755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:56.871607 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:56.871572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:57.428508 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:57.428469    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5798b55656-wvdnj" event={"ID":"8cce8a27-84c6-4c18-a89f-636fd3bc697f","Type":"ContainerStarted","Data":"afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c"}
Jul 09 17:40:57.447563 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:57.447494    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5798b55656-wvdnj" podStartSLOduration=1.9349266539999999 podStartE2EDuration="5.447473373s" totalImagesPullingTime="3.512546719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:40:57.446885134 +0000 UTC m=+111.492181656" watchObservedRunningTime="2026-07-09 17:40:57.447473373 +0000 UTC m=+111.492769887"
Jul 09 17:40:59.986723 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:40:59.986687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:00.774060 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:00.774021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:02.755635 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:02.755594    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:41:02.756176 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:02.755877    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:41:02.760500 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:02.760473    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:41:03.456122 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:03.456088    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:41:03.632958 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:03.632915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:03.705681 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:03.705642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:04.247204 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:04.247168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:04.321656 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:04.321617    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:06.461831 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:06.461798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:06.567374 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:06.567312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:06.636906 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:06.636867    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:16.153880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.153810    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5855f948f7-462wj" podUID="c0cb2478-62d9-4880-862e-68300e64fbdb" containerName="registry" containerID="cri-o://391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc" gracePeriod=30
Jul 09 17:41:16.402570 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.402544    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:41:16.502875 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.502788    2569 generic.go:356] "Generic (PLEG): container finished" podID="c0cb2478-62d9-4880-862e-68300e64fbdb" containerID="391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc" exitCode=0
Jul 09 17:41:16.502875 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.502833    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5855f948f7-462wj"
Jul 09 17:41:16.503059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.502871    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855f948f7-462wj" event={"ID":"c0cb2478-62d9-4880-862e-68300e64fbdb","Type":"ContainerDied","Data":"391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc"}
Jul 09 17:41:16.503059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.502923    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5855f948f7-462wj" event={"ID":"c0cb2478-62d9-4880-862e-68300e64fbdb","Type":"ContainerDied","Data":"70781e5687b1eae53fd7cf8ad6157dd2b54f368bde1aed03f47eb36603440c08"}
Jul 09 17:41:16.503059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.502954    2569 scope.go:117] "RemoveContainer" containerID="391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc"
Jul 09 17:41:16.510224 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510199    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh5n8\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-kube-api-access-vh5n8\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510350 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510237    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-installation-pull-secrets\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510350 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510280    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-image-registry-private-configuration\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510350 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510308    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-certificates\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510457 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510369    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-bound-sa-token\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510457 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510447    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0cb2478-62d9-4880-862e-68300e64fbdb-ca-trust-extracted\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510562 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510480    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-trusted-ca\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510562 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") pod \"c0cb2478-62d9-4880-862e-68300e64fbdb\" (UID: \"c0cb2478-62d9-4880-862e-68300e64fbdb\") "
Jul 09 17:41:16.510769 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:41:16.510921 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510899    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:41:16.510993 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.510966    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:41:16.512514 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.512388    2569 scope.go:117] "RemoveContainer" containerID="391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc"
Jul 09 17:41:16.513079 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:41:16.512952    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc\": container with ID starting with 391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc not found: ID does not exist" containerID="391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc"
Jul 09 17:41:16.513079 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.512993    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc"} err="failed to get container status \"391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc\": rpc error: code = NotFound desc = could not find container \"391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc\": container with ID starting with 391c576861f903f6154b71358be5466b766873c73a7ac3e6b36a6f7528eac1fc not found: ID does not exist"
Jul 09 17:41:16.513765 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.513708    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e8195f6-2749-44b3-ab58-dfb07e57b84c-metrics-certs\") pod \"network-metrics-daemon-ggjz7\" (UID: \"2e8195f6-2749-44b3-ab58-dfb07e57b84c\") " pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:41:16.513765 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.513733    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:41:16.514121 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.514098    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:41:16.514199 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.514121    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:41:16.514199 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.514181    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:41:16.514271 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.514237    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-kube-api-access-vh5n8" (OuterVolumeSpecName: "kube-api-access-vh5n8") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "kube-api-access-vh5n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:41:16.519285 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.519248    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cb2478-62d9-4880-862e-68300e64fbdb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c0cb2478-62d9-4880-862e-68300e64fbdb" (UID: "c0cb2478-62d9-4880-862e-68300e64fbdb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:41:16.521402 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.521382    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wznvh\""
Jul 09 17:41:16.530096 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.530067    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggjz7"
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612029    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-bound-sa-token\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612060    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0cb2478-62d9-4880-862e-68300e64fbdb-ca-trust-extracted\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612074    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-trusted-ca\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612087    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-tls\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612098    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh5n8\" (UniqueName: \"kubernetes.io/projected/c0cb2478-62d9-4880-862e-68300e64fbdb-kube-api-access-vh5n8\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612112    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-installation-pull-secrets\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612128    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0cb2478-62d9-4880-862e-68300e64fbdb-image-registry-private-configuration\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.612206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.612142    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0cb2478-62d9-4880-862e-68300e64fbdb-registry-certificates\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:41:16.662049 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.662002    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggjz7"]
Jul 09 17:41:16.667781 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:41:16.667720    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8195f6_2749_44b3_ab58_dfb07e57b84c.slice/crio-d3632d771c29407b1182dd408cf7e65c5ded128eb83b9b0dc283dc6d443f5a86 WatchSource:0}: Error finding container d3632d771c29407b1182dd408cf7e65c5ded128eb83b9b0dc283dc6d443f5a86: Status 404 returned error can't find the container with id d3632d771c29407b1182dd408cf7e65c5ded128eb83b9b0dc283dc6d443f5a86
Jul 09 17:41:16.824632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.824597    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5855f948f7-462wj"]
Jul 09 17:41:16.828185 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:16.828153    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5855f948f7-462wj"]
Jul 09 17:41:17.509589 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:17.509556    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggjz7" event={"ID":"2e8195f6-2749-44b3-ab58-dfb07e57b84c","Type":"ContainerStarted","Data":"d3632d771c29407b1182dd408cf7e65c5ded128eb83b9b0dc283dc6d443f5a86"}
Jul 09 17:41:18.498970 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:18.498923    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0cb2478-62d9-4880-862e-68300e64fbdb" path="/var/lib/kubelet/pods/c0cb2478-62d9-4880-862e-68300e64fbdb/volumes"
Jul 09 17:41:18.514443 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:18.514407    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggjz7" event={"ID":"2e8195f6-2749-44b3-ab58-dfb07e57b84c","Type":"ContainerStarted","Data":"db57f9eff4192b4c531ef6dc2fa1418cd361ce11ee0930dafd9dc59ad4f9c1a6"}
Jul 09 17:41:18.514852 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:18.514458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggjz7" event={"ID":"2e8195f6-2749-44b3-ab58-dfb07e57b84c","Type":"ContainerStarted","Data":"a0d6dfd28a2c3753a8ed34182c1f7bb3db2a851103d61df8f85ea99f15e6d0cd"}
Jul 09 17:41:18.532490 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:18.532418    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ggjz7" podStartSLOduration=130.735499965 podStartE2EDuration="2m11.532401275s" totalImagesPullingTime="796.90131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:41:18.531494602 +0000 UTC m=+132.576791115" watchObservedRunningTime="2026-07-09 17:41:18.532401275 +0000 UTC m=+132.577697785"
Jul 09 17:41:18.661419 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:18.661385    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:18.729001 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:18.728967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:21.448724 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:21.448685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:21.512776 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:21.512740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:30.565262 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:30.565222    2569 generic.go:356] "Generic (PLEG): container finished" podID="b7db9ab0-1686-44e0-9ad0-5496588b6eca" containerID="cec20a1b65a7e2dafb7f7d065f78ea03685e920dfb7a605a649018f5490a8ff6" exitCode=0
Jul 09 17:41:30.565703 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:30.565291    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk" event={"ID":"b7db9ab0-1686-44e0-9ad0-5496588b6eca","Type":"ContainerDied","Data":"cec20a1b65a7e2dafb7f7d065f78ea03685e920dfb7a605a649018f5490a8ff6"}
Jul 09 17:41:30.565755 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:30.565719    2569 scope.go:117] "RemoveContainer" containerID="cec20a1b65a7e2dafb7f7d065f78ea03685e920dfb7a605a649018f5490a8ff6"
Jul 09 17:41:31.571031 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:31.570992    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ft7pk" event={"ID":"b7db9ab0-1686-44e0-9ad0-5496588b6eca","Type":"ContainerStarted","Data":"dff26c2e9f4b1cf2e96bbe48e92d2b8543a1d0d821f72196ddb86b08d2f21c4c"}
Jul 09 17:41:36.464176 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:36.464143    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:36.529174 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:36.529128    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:36.592136 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:36.592100    2569 generic.go:356] "Generic (PLEG): container finished" podID="cca94c02-4238-466d-a7c5-e3150443423a" containerID="369d883b8085c0348177062fa5fad58fad1e51426fd4f6a78e556cde0a9fb179" exitCode=0
Jul 09 17:41:36.592301 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:36.592153    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx" event={"ID":"cca94c02-4238-466d-a7c5-e3150443423a","Type":"ContainerDied","Data":"369d883b8085c0348177062fa5fad58fad1e51426fd4f6a78e556cde0a9fb179"}
Jul 09 17:41:36.592494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:36.592481    2569 scope.go:117] "RemoveContainer" containerID="369d883b8085c0348177062fa5fad58fad1e51426fd4f6a78e556cde0a9fb179"
Jul 09 17:41:37.597182 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:37.597145    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-n7xwx" event={"ID":"cca94c02-4238-466d-a7c5-e3150443423a","Type":"ContainerStarted","Data":"b56218c06e5faddc747b90061a337884a6f989c862f123fdd356097d5886f031"}
Jul 09 17:41:41.612398 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:41.612360    2569 generic.go:356] "Generic (PLEG): container finished" podID="8b0a5699-d24e-46c4-bfcf-6db4240b79dc" containerID="36ff412fd3aca62e6cce6975dd021de4d0876f20dd4fbe9e9cd32a141ec69e15" exitCode=0
Jul 09 17:41:41.612993 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:41.612430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7" event={"ID":"8b0a5699-d24e-46c4-bfcf-6db4240b79dc","Type":"ContainerDied","Data":"36ff412fd3aca62e6cce6975dd021de4d0876f20dd4fbe9e9cd32a141ec69e15"}
Jul 09 17:41:41.612993 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:41.612795    2569 scope.go:117] "RemoveContainer" containerID="36ff412fd3aca62e6cce6975dd021de4d0876f20dd4fbe9e9cd32a141ec69e15"
Jul 09 17:41:42.618566 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:41:42.618514    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rssm7" event={"ID":"8b0a5699-d24e-46c4-bfcf-6db4240b79dc","Type":"ContainerStarted","Data":"de3134e08c811be2ffa262e045a40134ab4ebdb062281f48468ccfb8604328ca"}
Jul 09 17:42:06.342777 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:06.342686    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:06.629838 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:06.629798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:15.727033 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.726991    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6656647-nr9vz"]
Jul 09 17:42:15.727634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.727369    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cb2478-62d9-4880-862e-68300e64fbdb" containerName="registry"
Jul 09 17:42:15.727634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.727390    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cb2478-62d9-4880-862e-68300e64fbdb" containerName="registry"
Jul 09 17:42:15.727634 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.727488    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0cb2478-62d9-4880-862e-68300e64fbdb" containerName="registry"
Jul 09 17:42:15.730348 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.730323    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.741719 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.741686    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6656647-nr9vz"]
Jul 09 17:42:15.794308 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.794262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-oauth-serving-cert\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.794508 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.794360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5562c\" (UniqueName: \"kubernetes.io/projected/a94571df-aa8f-43cf-a510-9dcaf270598d-kube-api-access-5562c\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.794508 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.794397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-oauth-config\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.794508 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.794447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-serving-cert\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.794508 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.794502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-service-ca\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.794710 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.794616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-console-config\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.794750 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.794698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-trusted-ca-bundle\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.822767 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.822704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:15.895600 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.895516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-console-config\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.895600 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.895588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-trusted-ca-bundle\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.895879 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.895615    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-oauth-serving-cert\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.895879 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.895652    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5562c\" (UniqueName: \"kubernetes.io/projected/a94571df-aa8f-43cf-a510-9dcaf270598d-kube-api-access-5562c\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.895879 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.895680    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-oauth-config\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.895879 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.895717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-serving-cert\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.895879 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.895768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-service-ca\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.896484 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.896445    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-console-config\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.896641 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.896567    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-oauth-serving-cert\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.896641 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.896580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-service-ca\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.896761 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.896714    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-trusted-ca-bundle\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.898430 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.898403    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-oauth-config\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.898556 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.898439    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-serving-cert\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.906069 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.906044    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5562c\" (UniqueName: \"kubernetes.io/projected/a94571df-aa8f-43cf-a510-9dcaf270598d-kube-api-access-5562c\") pod \"console-6d6656647-nr9vz\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") " pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:15.923085 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:15.923051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:16.023815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.023697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:16.044262 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.044220    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:16.186891 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.186859    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6656647-nr9vz"]
Jul 09 17:42:16.189574 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:42:16.189545    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94571df_aa8f_43cf_a510_9dcaf270598d.slice/crio-2618c1401b6317224738234668e695ba3989282c565816bfce10437579d95d1f WatchSource:0}: Error finding container 2618c1401b6317224738234668e695ba3989282c565816bfce10437579d95d1f: Status 404 returned error can't find the container with id 2618c1401b6317224738234668e695ba3989282c565816bfce10437579d95d1f
Jul 09 17:42:16.533884 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.533847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:16.634709 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.634670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:16.761486 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.761450    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6656647-nr9vz" event={"ID":"a94571df-aa8f-43cf-a510-9dcaf270598d","Type":"ContainerStarted","Data":"9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0"}
Jul 09 17:42:16.761995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.761508    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6656647-nr9vz" event={"ID":"a94571df-aa8f-43cf-a510-9dcaf270598d","Type":"ContainerStarted","Data":"2618c1401b6317224738234668e695ba3989282c565816bfce10437579d95d1f"}
Jul 09 17:42:16.780830 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:16.780769    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6656647-nr9vz" podStartSLOduration=1.7807509430000001 podStartE2EDuration="1.780750943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:42:16.779220187 +0000 UTC m=+190.824516699" watchObservedRunningTime="2026-07-09 17:42:16.780750943 +0000 UTC m=+190.826047454"
Jul 09 17:42:21.572865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:21.572825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:21.629927 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:21.629892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:26.044646 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.044587    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:26.045072 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.044696    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:26.049477 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.049445    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:26.804398 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.804368    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:42:26.852428 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.852391    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5798b55656-wvdnj"]
Jul 09 17:42:26.929688 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.929286    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c8fc5db96-6h59v"]
Jul 09 17:42:26.932387 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.932356    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:26.945079 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.945047    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8fc5db96-6h59v"]
Jul 09 17:42:26.987201 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.987164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-trusted-ca-bundle\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:26.987201 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.987199    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbfgn\" (UniqueName: \"kubernetes.io/projected/90496c4a-ae33-46fa-90cd-de7b70ee10f6-kube-api-access-pbfgn\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:26.987430 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.987321    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-config\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:26.987430 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.987348    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-oauth-serving-cert\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:26.987430 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.987379    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-oauth-config\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:26.987430 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.987397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-serving-cert\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:26.987656 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:26.987495    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-service-ca\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.088590 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.088404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-config\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.088590 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.088449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-oauth-serving-cert\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089294 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.088626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-oauth-config\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089294 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.088672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-serving-cert\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089294 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.088718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-service-ca\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089294 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.088784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-trusted-ca-bundle\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089294 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.088811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbfgn\" (UniqueName: \"kubernetes.io/projected/90496c4a-ae33-46fa-90cd-de7b70ee10f6-kube-api-access-pbfgn\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089294 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.089249    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-config\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089803 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.089302    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-oauth-serving-cert\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089803 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.089415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-service-ca\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.089803 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.089700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-trusted-ca-bundle\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.091735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.091713    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-serving-cert\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.091838 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.091766    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-oauth-config\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.097304 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.097275    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbfgn\" (UniqueName: \"kubernetes.io/projected/90496c4a-ae33-46fa-90cd-de7b70ee10f6-kube-api-access-pbfgn\") pod \"console-6c8fc5db96-6h59v\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") " pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.244152 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.244099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:27.385143 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.382827    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8fc5db96-6h59v"]
Jul 09 17:42:27.386662 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:42:27.386630    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90496c4a_ae33_46fa_90cd_de7b70ee10f6.slice/crio-94db146ffaf0690993397a09ef03af7b7cdcb7aea7c4443ad91e2cbf8c3d12a0 WatchSource:0}: Error finding container 94db146ffaf0690993397a09ef03af7b7cdcb7aea7c4443ad91e2cbf8c3d12a0: Status 404 returned error can't find the container with id 94db146ffaf0690993397a09ef03af7b7cdcb7aea7c4443ad91e2cbf8c3d12a0
Jul 09 17:42:27.810805 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.810710    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8fc5db96-6h59v" event={"ID":"90496c4a-ae33-46fa-90cd-de7b70ee10f6","Type":"ContainerStarted","Data":"4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57"}
Jul 09 17:42:27.810805 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.810798    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8fc5db96-6h59v" event={"ID":"90496c4a-ae33-46fa-90cd-de7b70ee10f6","Type":"ContainerStarted","Data":"94db146ffaf0690993397a09ef03af7b7cdcb7aea7c4443ad91e2cbf8c3d12a0"}
Jul 09 17:42:27.828745 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:27.828687    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c8fc5db96-6h59v" podStartSLOduration=1.828669121 podStartE2EDuration="1.828669121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:42:27.827318885 +0000 UTC m=+201.872615399" watchObservedRunningTime="2026-07-09 17:42:27.828669121 +0000 UTC m=+201.873965693"
Jul 09 17:42:33.436936 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:33.436896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:33.494212 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:33.494170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:36.463121 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:36.463079    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:36.564264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:36.564221    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:37.245115 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:37.245080    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:37.245295 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:37.245170    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:37.250083 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:37.250061    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:37.852489 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:37.852458    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:42:37.905093 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:37.905052    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6656647-nr9vz"]
Jul 09 17:42:38.014483 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:38.014442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:38.121849 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:38.121752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:38.221743 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:38.221704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:51.877066 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:51.877005    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5798b55656-wvdnj" podUID="8cce8a27-84c6-4c18-a89f-636fd3bc697f" containerName="console" containerID="cri-o://afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c" gracePeriod=15
Jul 09 17:42:52.134345 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.134276    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:42:52.307150 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307106    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-trusted-ca-bundle\") pod \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") "
Jul 09 17:42:52.307334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307183    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dffkd\" (UniqueName: \"kubernetes.io/projected/8cce8a27-84c6-4c18-a89f-636fd3bc697f-kube-api-access-dffkd\") pod \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") "
Jul 09 17:42:52.307334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307214    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-service-ca\") pod \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") "
Jul 09 17:42:52.307334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307241    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-serving-cert\") pod \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") "
Jul 09 17:42:52.307334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307284    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-oauth-serving-cert\") pod \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") "
Jul 09 17:42:52.307334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307334    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-oauth-config\") pod \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") "
Jul 09 17:42:52.307625 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307359    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-config\") pod \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\" (UID: \"8cce8a27-84c6-4c18-a89f-636fd3bc697f\") "
Jul 09 17:42:52.307743 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307700    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8cce8a27-84c6-4c18-a89f-636fd3bc697f" (UID: "8cce8a27-84c6-4c18-a89f-636fd3bc697f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:42:52.307743 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307716    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-service-ca" (OuterVolumeSpecName: "service-ca") pod "8cce8a27-84c6-4c18-a89f-636fd3bc697f" (UID: "8cce8a27-84c6-4c18-a89f-636fd3bc697f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:42:52.307898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307808    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-config" (OuterVolumeSpecName: "console-config") pod "8cce8a27-84c6-4c18-a89f-636fd3bc697f" (UID: "8cce8a27-84c6-4c18-a89f-636fd3bc697f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:42:52.307898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.307843    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8cce8a27-84c6-4c18-a89f-636fd3bc697f" (UID: "8cce8a27-84c6-4c18-a89f-636fd3bc697f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:42:52.309771 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.309735    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8cce8a27-84c6-4c18-a89f-636fd3bc697f" (UID: "8cce8a27-84c6-4c18-a89f-636fd3bc697f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:42:52.309880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.309837    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8cce8a27-84c6-4c18-a89f-636fd3bc697f" (UID: "8cce8a27-84c6-4c18-a89f-636fd3bc697f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:42:52.309880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.309856    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cce8a27-84c6-4c18-a89f-636fd3bc697f-kube-api-access-dffkd" (OuterVolumeSpecName: "kube-api-access-dffkd") pod "8cce8a27-84c6-4c18-a89f-636fd3bc697f" (UID: "8cce8a27-84c6-4c18-a89f-636fd3bc697f"). InnerVolumeSpecName "kube-api-access-dffkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:42:52.408610 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.408473    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-trusted-ca-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:42:52.408610 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.408551    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dffkd\" (UniqueName: \"kubernetes.io/projected/8cce8a27-84c6-4c18-a89f-636fd3bc697f-kube-api-access-dffkd\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:42:52.408610 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.408567    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-service-ca\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:42:52.408610 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.408577    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-serving-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:42:52.408610 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.408586    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-oauth-serving-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:42:52.408610 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.408595    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-oauth-config\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:42:52.408610 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.408603    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cce8a27-84c6-4c18-a89f-636fd3bc697f-console-config\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:42:52.909374 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.909339    2569 generic.go:356] "Generic (PLEG): container finished" podID="8cce8a27-84c6-4c18-a89f-636fd3bc697f" containerID="afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c" exitCode=0
Jul 09 17:42:52.909859 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.909385    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5798b55656-wvdnj"
Jul 09 17:42:52.909859 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.909419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5798b55656-wvdnj" event={"ID":"8cce8a27-84c6-4c18-a89f-636fd3bc697f","Type":"ContainerDied","Data":"afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c"}
Jul 09 17:42:52.909859 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.909467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5798b55656-wvdnj" event={"ID":"8cce8a27-84c6-4c18-a89f-636fd3bc697f","Type":"ContainerDied","Data":"6b1f1cbc2dc2b620d794d093ce319f1aeba69dcf4e29a079ead87826e3c6c432"}
Jul 09 17:42:52.909859 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.909487    2569 scope.go:117] "RemoveContainer" containerID="afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c"
Jul 09 17:42:52.919163 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.919137    2569 scope.go:117] "RemoveContainer" containerID="afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c"
Jul 09 17:42:52.919550 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:42:52.919515    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c\": container with ID starting with afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c not found: ID does not exist" containerID="afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c"
Jul 09 17:42:52.919619 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.919563    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c"} err="failed to get container status \"afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c\": rpc error: code = NotFound desc = could not find container \"afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c\": container with ID starting with afc63110effcf99995619a28c55f84a8829da99d516d555ecac1c6d45919d02c not found: ID does not exist"
Jul 09 17:42:52.925310 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.925272    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5798b55656-wvdnj"]
Jul 09 17:42:52.929624 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:52.929588    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5798b55656-wvdnj"]
Jul 09 17:42:54.499386 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:42:54.499337    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cce8a27-84c6-4c18-a89f-636fd3bc697f" path="/var/lib/kubelet/pods/8cce8a27-84c6-4c18-a89f-636fd3bc697f/volumes"
Jul 09 17:43:01.705512 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:01.705468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:43:01.806644 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:01.806604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:43:02.928809 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:02.928744    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d6656647-nr9vz" podUID="a94571df-aa8f-43cf-a510-9dcaf270598d" containerName="console" containerID="cri-o://9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0" gracePeriod=15
Jul 09 17:43:03.175343 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.175315    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:43:03.299581 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.299456    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-oauth-config\") pod \"a94571df-aa8f-43cf-a510-9dcaf270598d\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") "
Jul 09 17:43:03.299581 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.299549    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5562c\" (UniqueName: \"kubernetes.io/projected/a94571df-aa8f-43cf-a510-9dcaf270598d-kube-api-access-5562c\") pod \"a94571df-aa8f-43cf-a510-9dcaf270598d\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") "
Jul 09 17:43:03.299581 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.299576    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-console-config\") pod \"a94571df-aa8f-43cf-a510-9dcaf270598d\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") "
Jul 09 17:43:03.299876 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.299748    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-trusted-ca-bundle\") pod \"a94571df-aa8f-43cf-a510-9dcaf270598d\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") "
Jul 09 17:43:03.299876 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.299792    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-oauth-serving-cert\") pod \"a94571df-aa8f-43cf-a510-9dcaf270598d\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") "
Jul 09 17:43:03.299876 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.299840    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-service-ca\") pod \"a94571df-aa8f-43cf-a510-9dcaf270598d\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") "
Jul 09 17:43:03.300028 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.299880    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-serving-cert\") pod \"a94571df-aa8f-43cf-a510-9dcaf270598d\" (UID: \"a94571df-aa8f-43cf-a510-9dcaf270598d\") "
Jul 09 17:43:03.300094 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.300022    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-console-config" (OuterVolumeSpecName: "console-config") pod "a94571df-aa8f-43cf-a510-9dcaf270598d" (UID: "a94571df-aa8f-43cf-a510-9dcaf270598d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:43:03.300167 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.300142    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a94571df-aa8f-43cf-a510-9dcaf270598d" (UID: "a94571df-aa8f-43cf-a510-9dcaf270598d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:43:03.300231 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.300174    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-console-config\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:43:03.300231 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.300197    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a94571df-aa8f-43cf-a510-9dcaf270598d" (UID: "a94571df-aa8f-43cf-a510-9dcaf270598d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:43:03.300300 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.300232    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-service-ca" (OuterVolumeSpecName: "service-ca") pod "a94571df-aa8f-43cf-a510-9dcaf270598d" (UID: "a94571df-aa8f-43cf-a510-9dcaf270598d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:43:03.301805 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.301784    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a94571df-aa8f-43cf-a510-9dcaf270598d" (UID: "a94571df-aa8f-43cf-a510-9dcaf270598d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:43:03.301889 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.301869    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a94571df-aa8f-43cf-a510-9dcaf270598d-kube-api-access-5562c" (OuterVolumeSpecName: "kube-api-access-5562c") pod "a94571df-aa8f-43cf-a510-9dcaf270598d" (UID: "a94571df-aa8f-43cf-a510-9dcaf270598d"). InnerVolumeSpecName "kube-api-access-5562c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:43:03.302059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.302039    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a94571df-aa8f-43cf-a510-9dcaf270598d" (UID: "a94571df-aa8f-43cf-a510-9dcaf270598d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:43:03.400777 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.400722    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5562c\" (UniqueName: \"kubernetes.io/projected/a94571df-aa8f-43cf-a510-9dcaf270598d-kube-api-access-5562c\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:43:03.400777 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.400766    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-trusted-ca-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:43:03.400777 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.400776    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-oauth-serving-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:43:03.400777 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.400785    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a94571df-aa8f-43cf-a510-9dcaf270598d-service-ca\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:43:03.400777 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.400795    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-serving-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:43:03.401082 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.400805    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a94571df-aa8f-43cf-a510-9dcaf270598d-console-oauth-config\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:43:03.954944 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.954906    2569 generic.go:356] "Generic (PLEG): container finished" podID="a94571df-aa8f-43cf-a510-9dcaf270598d" containerID="9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0" exitCode=0
Jul 09 17:43:03.955423 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.954972    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6656647-nr9vz" event={"ID":"a94571df-aa8f-43cf-a510-9dcaf270598d","Type":"ContainerDied","Data":"9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0"}
Jul 09 17:43:03.955423 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.954975    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6656647-nr9vz"
Jul 09 17:43:03.955423 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.955014    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6656647-nr9vz" event={"ID":"a94571df-aa8f-43cf-a510-9dcaf270598d","Type":"ContainerDied","Data":"2618c1401b6317224738234668e695ba3989282c565816bfce10437579d95d1f"}
Jul 09 17:43:03.955423 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.955034    2569 scope.go:117] "RemoveContainer" containerID="9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0"
Jul 09 17:43:03.963657 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.963639    2569 scope.go:117] "RemoveContainer" containerID="9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0"
Jul 09 17:43:03.963961 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:43:03.963940    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0\": container with ID starting with 9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0 not found: ID does not exist" containerID="9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0"
Jul 09 17:43:03.964010 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.963971    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0"} err="failed to get container status \"9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0\": rpc error: code = NotFound desc = could not find container \"9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0\": container with ID starting with 9f8adeb0f0c25847bd2cad7443362452fba3874b9d5e86030393b2ccaf68a3b0 not found: ID does not exist"
Jul 09 17:43:03.974513 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.974480    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6656647-nr9vz"]
Jul 09 17:43:03.980744 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:03.980717    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6656647-nr9vz"]
Jul 09 17:43:04.499376 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:43:04.499343    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a94571df-aa8f-43cf-a510-9dcaf270598d" path="/var/lib/kubelet/pods/a94571df-aa8f-43cf-a510-9dcaf270598d/volumes"
Jul 09 17:44:06.379209 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:06.379175    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:44:06.383362 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:06.383340    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:44:06.383362 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:06.383353    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:44:06.387890 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:06.387866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:44:06.391176 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:06.391155    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 17:44:56.831995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:56.831957    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:44:58.526747 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.526658    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"]
Jul 09 17:44:58.527111 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.526978    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cce8a27-84c6-4c18-a89f-636fd3bc697f" containerName="console"
Jul 09 17:44:58.527111 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.526991    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cce8a27-84c6-4c18-a89f-636fd3bc697f" containerName="console"
Jul 09 17:44:58.527111 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.527011    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a94571df-aa8f-43cf-a510-9dcaf270598d" containerName="console"
Jul 09 17:44:58.527111 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.527016    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a94571df-aa8f-43cf-a510-9dcaf270598d" containerName="console"
Jul 09 17:44:58.527111 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.527071    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cce8a27-84c6-4c18-a89f-636fd3bc697f" containerName="console"
Jul 09 17:44:58.527111 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.527079    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a94571df-aa8f-43cf-a510-9dcaf270598d" containerName="console"
Jul 09 17:44:58.530080 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.530061    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.532733 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.532697    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 17:44:58.533429 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.533411    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 17:44:58.533520 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.533446    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qv4q5\""
Jul 09 17:44:58.551367 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.551334    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"]
Jul 09 17:44:58.610474 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.610436    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.610474 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.610478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.610705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.610513    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9jd5\" (UniqueName: \"kubernetes.io/projected/21c19d01-5f87-43a1-bce0-bc9d32ad15af-kube-api-access-m9jd5\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.711737 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.711672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.711737 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.711735    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.711964 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.711777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9jd5\" (UniqueName: \"kubernetes.io/projected/21c19d01-5f87-43a1-bce0-bc9d32ad15af-kube-api-access-m9jd5\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.712094 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.712074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.712214 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.712197    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.730430 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.730396    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9jd5\" (UniqueName: \"kubernetes.io/projected/21c19d01-5f87-43a1-bce0-bc9d32ad15af-kube-api-access-m9jd5\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.838721 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.838618    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:44:58.975276 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.975241    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"]
Jul 09 17:44:58.977563 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:44:58.977521    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c19d01_5f87_43a1_bce0_bc9d32ad15af.slice/crio-e7c281aafe198062923dbca312887fef16afaec7185e13e593f582b02b68fd6b WatchSource:0}: Error finding container e7c281aafe198062923dbca312887fef16afaec7185e13e593f582b02b68fd6b: Status 404 returned error can't find the container with id e7c281aafe198062923dbca312887fef16afaec7185e13e593f582b02b68fd6b
Jul 09 17:44:58.979490 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:58.979476    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:44:59.393204 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:59.393165    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5" event={"ID":"21c19d01-5f87-43a1-bce0-bc9d32ad15af","Type":"ContainerStarted","Data":"e7c281aafe198062923dbca312887fef16afaec7185e13e593f582b02b68fd6b"}
Jul 09 17:44:59.393512 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:44:59.393493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:08.430855 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:08.430755    2569 generic.go:356] "Generic (PLEG): container finished" podID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerID="9d9fffcbbe2057b3c6f3da13fae1a7f82d27588cd9ebf2d6c71bb820203104a6" exitCode=0
Jul 09 17:45:08.430855 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:08.430838    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5" event={"ID":"21c19d01-5f87-43a1-bce0-bc9d32ad15af","Type":"ContainerDied","Data":"9d9fffcbbe2057b3c6f3da13fae1a7f82d27588cd9ebf2d6c71bb820203104a6"}
Jul 09 17:45:11.494175 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:11.494130    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:18.473748 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:18.473713    2569 generic.go:356] "Generic (PLEG): container finished" podID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerID="06ead098bb450398de5b5c23fab72202bfb9436235ba23d220f32ab4a4f4718f" exitCode=0
Jul 09 17:45:18.474214 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:18.473770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5" event={"ID":"21c19d01-5f87-43a1-bce0-bc9d32ad15af","Type":"ContainerDied","Data":"06ead098bb450398de5b5c23fab72202bfb9436235ba23d220f32ab4a4f4718f"}
Jul 09 17:45:26.511715 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:26.511621    2569 generic.go:356] "Generic (PLEG): container finished" podID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerID="7f9564447b01f824653ae78675b0db6b078e7417d25794b1f4d55af55f08f399" exitCode=0
Jul 09 17:45:26.511715 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:26.511698    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5" event={"ID":"21c19d01-5f87-43a1-bce0-bc9d32ad15af","Type":"ContainerDied","Data":"7f9564447b01f824653ae78675b0db6b078e7417d25794b1f4d55af55f08f399"}
Jul 09 17:45:27.648558 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.648513    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:45:27.763420 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.763367    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-bundle\") pod \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") "
Jul 09 17:45:27.763660 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.763444    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-util\") pod \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") "
Jul 09 17:45:27.763660 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.763463    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9jd5\" (UniqueName: \"kubernetes.io/projected/21c19d01-5f87-43a1-bce0-bc9d32ad15af-kube-api-access-m9jd5\") pod \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\" (UID: \"21c19d01-5f87-43a1-bce0-bc9d32ad15af\") "
Jul 09 17:45:27.764119 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.764091    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-bundle" (OuterVolumeSpecName: "bundle") pod "21c19d01-5f87-43a1-bce0-bc9d32ad15af" (UID: "21c19d01-5f87-43a1-bce0-bc9d32ad15af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:45:27.765881 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.765807    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c19d01-5f87-43a1-bce0-bc9d32ad15af-kube-api-access-m9jd5" (OuterVolumeSpecName: "kube-api-access-m9jd5") pod "21c19d01-5f87-43a1-bce0-bc9d32ad15af" (UID: "21c19d01-5f87-43a1-bce0-bc9d32ad15af"). InnerVolumeSpecName "kube-api-access-m9jd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:45:27.767788 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.767766    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-util" (OuterVolumeSpecName: "util") pod "21c19d01-5f87-43a1-bce0-bc9d32ad15af" (UID: "21c19d01-5f87-43a1-bce0-bc9d32ad15af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:45:27.864612 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.864568    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:45:27.864612 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.864602    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c19d01-5f87-43a1-bce0-bc9d32ad15af-util\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:45:27.864612 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:27.864613    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9jd5\" (UniqueName: \"kubernetes.io/projected/21c19d01-5f87-43a1-bce0-bc9d32ad15af-kube-api-access-m9jd5\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:45:28.521167 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:28.521131    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5" event={"ID":"21c19d01-5f87-43a1-bce0-bc9d32ad15af","Type":"ContainerDied","Data":"e7c281aafe198062923dbca312887fef16afaec7185e13e593f582b02b68fd6b"}
Jul 09 17:45:28.521167 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:28.521162    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f4dz5"
Jul 09 17:45:28.521379 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:28.521189    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7c281aafe198062923dbca312887fef16afaec7185e13e593f582b02b68fd6b"
Jul 09 17:45:30.110718 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:30.110668    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:30.213975 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:30.213946    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:32.119908 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.119868    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"]
Jul 09 17:45:32.120406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.120357    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerName="pull"
Jul 09 17:45:32.120406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.120376    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerName="pull"
Jul 09 17:45:32.120406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.120389    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerName="util"
Jul 09 17:45:32.120406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.120397    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerName="util"
Jul 09 17:45:32.120406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.120406    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerName="extract"
Jul 09 17:45:32.120687 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.120415    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerName="extract"
Jul 09 17:45:32.120687 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.120494    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c19d01-5f87-43a1-bce0-bc9d32ad15af" containerName="extract"
Jul 09 17:45:32.123447 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.123422    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.127061 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.127007    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 09 17:45:32.127197 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.127106    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 09 17:45:32.127197 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.127118    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 09 17:45:32.127197 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.127118    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-9q67w\""
Jul 09 17:45:32.148372 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.148338    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"]
Jul 09 17:45:32.195654 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.195618    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/fd5266b6-120f-4ea0-832b-690cfb3f1616-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx\" (UID: \"fd5266b6-120f-4ea0-832b-690cfb3f1616\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.195654 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.195655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spttc\" (UniqueName: \"kubernetes.io/projected/fd5266b6-120f-4ea0-832b-690cfb3f1616-kube-api-access-spttc\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx\" (UID: \"fd5266b6-120f-4ea0-832b-690cfb3f1616\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.296071 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.296009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/fd5266b6-120f-4ea0-832b-690cfb3f1616-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx\" (UID: \"fd5266b6-120f-4ea0-832b-690cfb3f1616\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.296071 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.296079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spttc\" (UniqueName: \"kubernetes.io/projected/fd5266b6-120f-4ea0-832b-690cfb3f1616-kube-api-access-spttc\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx\" (UID: \"fd5266b6-120f-4ea0-832b-690cfb3f1616\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.298439 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.298405    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/fd5266b6-120f-4ea0-832b-690cfb3f1616-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx\" (UID: \"fd5266b6-120f-4ea0-832b-690cfb3f1616\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.305456 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.305429    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spttc\" (UniqueName: \"kubernetes.io/projected/fd5266b6-120f-4ea0-832b-690cfb3f1616-kube-api-access-spttc\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx\" (UID: \"fd5266b6-120f-4ea0-832b-690cfb3f1616\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.433829 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.433784    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:32.615063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:32.615029    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"]
Jul 09 17:45:32.618397 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:45:32.618371    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5266b6_120f_4ea0_832b_690cfb3f1616.slice/crio-8e01b4b6805490f856e756d7a673a4af04b2b6d5d6991d4fdddd79d761ec16d3 WatchSource:0}: Error finding container 8e01b4b6805490f856e756d7a673a4af04b2b6d5d6991d4fdddd79d761ec16d3: Status 404 returned error can't find the container with id 8e01b4b6805490f856e756d7a673a4af04b2b6d5d6991d4fdddd79d761ec16d3
Jul 09 17:45:33.545856 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:33.545815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx" event={"ID":"fd5266b6-120f-4ea0-832b-690cfb3f1616","Type":"ContainerStarted","Data":"8e01b4b6805490f856e756d7a673a4af04b2b6d5d6991d4fdddd79d761ec16d3"}
Jul 09 17:45:35.559630 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:35.559579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx" event={"ID":"fd5266b6-120f-4ea0-832b-690cfb3f1616","Type":"ContainerStarted","Data":"5155c683452cd126b19d7c4c6d3c25156b2a054dcfa82cb4ea8462bafd451207"}
Jul 09 17:45:35.560102 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:35.559768    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:45:35.593011 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:35.592953    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx" podStartSLOduration=0.843425504 podStartE2EDuration="3.592936437s" totalImagesPullingTime="2.749510933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:35.592632192 +0000 UTC m=+389.637928706" watchObservedRunningTime="2026-07-09 17:45:35.592936437 +0000 UTC m=+389.638232947"
Jul 09 17:45:35.957206 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:35.957172    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:36.265068 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.264979    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:36.272479 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.272446    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-8fdjb"]
Jul 09 17:45:36.275608 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.275583    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.277814 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.277786    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 09 17:45:36.277952 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.277880    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 09 17:45:36.277952 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.277937    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-h6hxd\""
Jul 09 17:45:36.284955 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.284919    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-8fdjb"]
Jul 09 17:45:36.331904 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.331870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb2ld\" (UniqueName: \"kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-kube-api-access-xb2ld\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.331904 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.331911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-certificates\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.332214 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.331946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-cabundle0\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.432504 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.432465    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2ld\" (UniqueName: \"kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-kube-api-access-xb2ld\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.432504 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.432507    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-certificates\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.432738 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.432569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-cabundle0\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.432790 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:45:36.432732    2569 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 09 17:45:36.432790 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:45:36.432760    2569 secret.go:281] references non-existent secret key: ca.crt
Jul 09 17:45:36.432790 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:45:36.432772    2569 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 09 17:45:36.432790 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:45:36.432788    2569 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-8fdjb: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 09 17:45:36.432930 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:45:36.432862    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-certificates podName:d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad nodeName:}" failed. No retries permitted until 2026-07-09 17:45:36.932841428 +0000 UTC m=+390.978137921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-certificates") pod "keda-operator-68bff59c-8fdjb" (UID: "d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 09 17:45:36.433282 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.433264    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-cabundle0\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.442062 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.442031    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2ld\" (UniqueName: \"kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-kube-api-access-xb2ld\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.538620 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.535335    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:36.630917 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.630880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:36.735304 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.735268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:36.788107 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.788072    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"]
Jul 09 17:45:36.791517 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.791467    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.793581 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.793554    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 09 17:45:36.801359 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.801318    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"]
Jul 09 17:45:36.836164 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.836125    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w29zw\" (UniqueName: \"kubernetes.io/projected/51357f63-7d2c-4375-8426-29b2af62e92a-kube-api-access-w29zw\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.836164 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.836170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/51357f63-7d2c-4375-8426-29b2af62e92a-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.836445 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.836198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/51357f63-7d2c-4375-8426-29b2af62e92a-certificates\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.937121 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.937069    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w29zw\" (UniqueName: \"kubernetes.io/projected/51357f63-7d2c-4375-8426-29b2af62e92a-kube-api-access-w29zw\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.937303 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.937134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/51357f63-7d2c-4375-8426-29b2af62e92a-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.937303 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.937172    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/51357f63-7d2c-4375-8426-29b2af62e92a-certificates\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.937303 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.937225    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-certificates\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.937582 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.937554    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/51357f63-7d2c-4375-8426-29b2af62e92a-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.939839 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.939809    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/51357f63-7d2c-4375-8426-29b2af62e92a-certificates\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:36.939839 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.939831    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad-certificates\") pod \"keda-operator-68bff59c-8fdjb\" (UID: \"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad\") " pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:36.949606 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:36.949578    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w29zw\" (UniqueName: \"kubernetes.io/projected/51357f63-7d2c-4375-8426-29b2af62e92a-kube-api-access-w29zw\") pod \"keda-metrics-apiserver-559f75f947-n9q2x\" (UID: \"51357f63-7d2c-4375-8426-29b2af62e92a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:37.034353 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.034306    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:37.071159 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.071078    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-6tscq"]
Jul 09 17:45:37.074436 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.074409    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.077007 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.076989    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 09 17:45:37.096828 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.096795    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-6tscq"]
Jul 09 17:45:37.104127 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.104098    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:37.136053 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.136016    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:37.139081 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.139052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5dcdc3ff-1082-485b-9ecc-3166265bcfd2-certificates\") pod \"keda-admission-5fbd5c4644-6tscq\" (UID: \"5dcdc3ff-1082-485b-9ecc-3166265bcfd2\") " pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.139081 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.139085    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfwx2\" (UniqueName: \"kubernetes.io/projected/5dcdc3ff-1082-485b-9ecc-3166265bcfd2-kube-api-access-tfwx2\") pod \"keda-admission-5fbd5c4644-6tscq\" (UID: \"5dcdc3ff-1082-485b-9ecc-3166265bcfd2\") " pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.187130 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.187097    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:37.230018 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.229976    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:37.239922 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.239830    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5dcdc3ff-1082-485b-9ecc-3166265bcfd2-certificates\") pod \"keda-admission-5fbd5c4644-6tscq\" (UID: \"5dcdc3ff-1082-485b-9ecc-3166265bcfd2\") " pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.239922 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.239880    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfwx2\" (UniqueName: \"kubernetes.io/projected/5dcdc3ff-1082-485b-9ecc-3166265bcfd2-kube-api-access-tfwx2\") pod \"keda-admission-5fbd5c4644-6tscq\" (UID: \"5dcdc3ff-1082-485b-9ecc-3166265bcfd2\") " pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.243555 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.243498    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5dcdc3ff-1082-485b-9ecc-3166265bcfd2-certificates\") pod \"keda-admission-5fbd5c4644-6tscq\" (UID: \"5dcdc3ff-1082-485b-9ecc-3166265bcfd2\") " pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.248771 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.248717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfwx2\" (UniqueName: \"kubernetes.io/projected/5dcdc3ff-1082-485b-9ecc-3166265bcfd2-kube-api-access-tfwx2\") pod \"keda-admission-5fbd5c4644-6tscq\" (UID: \"5dcdc3ff-1082-485b-9ecc-3166265bcfd2\") " pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.259832 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.259797    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"]
Jul 09 17:45:37.262939 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:45:37.262908    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51357f63_7d2c_4375_8426_29b2af62e92a.slice/crio-9c255e9d23d24a7afd1c0ed1123f6ea9507a4b8b72593201b81498966075af1a WatchSource:0}: Error finding container 9c255e9d23d24a7afd1c0ed1123f6ea9507a4b8b72593201b81498966075af1a: Status 404 returned error can't find the container with id 9c255e9d23d24a7afd1c0ed1123f6ea9507a4b8b72593201b81498966075af1a
Jul 09 17:45:37.340858 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.340768    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-8fdjb"]
Jul 09 17:45:37.345679 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:45:37.345647    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a9a36a_b1d5_4d8c_8b6d_82344702d7ad.slice/crio-261620d9fe5a42dffd09e4fe15a8927ac164184945b338b5edf4152a0b848408 WatchSource:0}: Error finding container 261620d9fe5a42dffd09e4fe15a8927ac164184945b338b5edf4152a0b848408: Status 404 returned error can't find the container with id 261620d9fe5a42dffd09e4fe15a8927ac164184945b338b5edf4152a0b848408
Jul 09 17:45:37.385349 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.385314    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:37.433493 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.433442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:37.562072 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.562035    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-6tscq"]
Jul 09 17:45:37.565761 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:45:37.565724    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcdc3ff_1082_485b_9ecc_3166265bcfd2.slice/crio-a9085b28fc547dfb1dc84d07cafa4927b42cbd43b917a68576af249a4e6f3a1e WatchSource:0}: Error finding container a9085b28fc547dfb1dc84d07cafa4927b42cbd43b917a68576af249a4e6f3a1e: Status 404 returned error can't find the container with id a9085b28fc547dfb1dc84d07cafa4927b42cbd43b917a68576af249a4e6f3a1e
Jul 09 17:45:37.570468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.570432    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-8fdjb" event={"ID":"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad","Type":"ContainerStarted","Data":"261620d9fe5a42dffd09e4fe15a8927ac164184945b338b5edf4152a0b848408"}
Jul 09 17:45:37.571804 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.571757    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x" event={"ID":"51357f63-7d2c-4375-8426-29b2af62e92a","Type":"ContainerStarted","Data":"9c255e9d23d24a7afd1c0ed1123f6ea9507a4b8b72593201b81498966075af1a"}
Jul 09 17:45:37.695439 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.695393    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:37.791274 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.791239    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:37.886847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.886803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:37.989250 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:37.989155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:38.580046 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:38.580006    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-6tscq" event={"ID":"5dcdc3ff-1082-485b-9ecc-3166265bcfd2","Type":"ContainerStarted","Data":"a9085b28fc547dfb1dc84d07cafa4927b42cbd43b917a68576af249a4e6f3a1e"}
Jul 09 17:45:41.180054 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.180020    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:41.596791 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.596679    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-8fdjb" event={"ID":"d1a9a36a-b1d5-4d8c-8b6d-82344702d7ad","Type":"ContainerStarted","Data":"429ea6a4a3434733e0bedc83e024d6510e9213ea6520e861b7f16ad8acde4d28"}
Jul 09 17:45:41.596791 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.596790    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:45:41.598427 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.598388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x" event={"ID":"51357f63-7d2c-4375-8426-29b2af62e92a","Type":"ContainerStarted","Data":"ca984a1b2a326ff813098a37f2a8ee38d743b8d81bc7156700f65dacead936cb"}
Jul 09 17:45:41.598687 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.598459    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:41.599936 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.599910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-6tscq" event={"ID":"5dcdc3ff-1082-485b-9ecc-3166265bcfd2","Type":"ContainerStarted","Data":"8290b2b589146f58f12ee010f66752b8166e1bb7a8a506aa95dce76cbddfb2ab"}
Jul 09 17:45:41.600056 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.599960    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:45:41.635171 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.635112    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-8fdjb" podStartSLOduration=1.7186009119999999 podStartE2EDuration="5.635092911s" totalImagesPullingTime="3.916491999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:41.634759293 +0000 UTC m=+395.680055804" watchObservedRunningTime="2026-07-09 17:45:41.635092911 +0000 UTC m=+395.680389422"
Jul 09 17:45:41.680723 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.680662    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x" podStartSLOduration=1.693308926 podStartE2EDuration="5.680644458s" totalImagesPullingTime="3.987335532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:41.67846605 +0000 UTC m=+395.723762562" watchObservedRunningTime="2026-07-09 17:45:41.680644458 +0000 UTC m=+395.725940970"
Jul 09 17:45:41.714017 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:41.713960    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-6tscq" podStartSLOduration=1.032842811 podStartE2EDuration="4.713941599s" totalImagesPullingTime="3.681098788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:41.712755931 +0000 UTC m=+395.758052441" watchObservedRunningTime="2026-07-09 17:45:41.713941599 +0000 UTC m=+395.759238110"
Jul 09 17:45:47.076191 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:47.076159    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:47.227915 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:47.227883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:52.609163 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:52.609130    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-n9q2x"
Jul 09 17:45:56.565636 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:45:56.565608    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-q6wmx"
Jul 09 17:46:02.606938 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:02.606907    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-8fdjb"
Jul 09 17:46:02.607402 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:02.606978    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-6tscq"
Jul 09 17:46:48.696279 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.696230    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:48.782701 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.782662    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-wmkwl"]
Jul 09 17:46:48.783370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.783336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:48.785427 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.785403    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:48.787917 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.787887    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-jx6kp\""
Jul 09 17:46:48.788075 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.787887    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 09 17:46:48.788349 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.788326    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 09 17:46:48.788474 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.788420    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 09 17:46:48.797007 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.796970    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-wmkwl"]
Jul 09 17:46:48.837788 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.837759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7svcr\" (UniqueName: \"kubernetes.io/projected/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-kube-api-access-7svcr\") pod \"kserve-controller-manager-6b8548bc6d-wmkwl\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") " pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:48.837972 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.837895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert\") pod \"kserve-controller-manager-6b8548bc6d-wmkwl\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") " pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:48.853045 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.853002    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-g9kxn"]
Jul 09 17:46:48.855199 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.855174    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:48.857955 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.857931    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-nrr6p\""
Jul 09 17:46:48.858112 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.857933    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 09 17:46:48.869127 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.869091    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-g9kxn"]
Jul 09 17:46:48.937469 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.937434    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:48.938520 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.938498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b359f26-a19e-497f-ab1e-0aa71d097b02-data\") pod \"seaweedfs-64568bcd49-g9kxn\" (UID: \"3b359f26-a19e-497f-ab1e-0aa71d097b02\") " pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:48.938662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.938560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmzqn\" (UniqueName: \"kubernetes.io/projected/3b359f26-a19e-497f-ab1e-0aa71d097b02-kube-api-access-xmzqn\") pod \"seaweedfs-64568bcd49-g9kxn\" (UID: \"3b359f26-a19e-497f-ab1e-0aa71d097b02\") " pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:48.938662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.938618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert\") pod \"kserve-controller-manager-6b8548bc6d-wmkwl\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") " pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:48.938772 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.938686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svcr\" (UniqueName: \"kubernetes.io/projected/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-kube-api-access-7svcr\") pod \"kserve-controller-manager-6b8548bc6d-wmkwl\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") " pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:48.938772 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:46:48.938715    2569 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 09 17:46:48.938868 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:46:48.938784    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert podName:eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7 nodeName:}" failed. No retries permitted until 2026-07-09 17:46:49.438760067 +0000 UTC m=+463.484056558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert") pod "kserve-controller-manager-6b8548bc6d-wmkwl" (UID: "eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7") : secret "kserve-webhook-server-cert" not found
Jul 09 17:46:48.954308 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:48.954228    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7svcr\" (UniqueName: \"kubernetes.io/projected/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-kube-api-access-7svcr\") pod \"kserve-controller-manager-6b8548bc6d-wmkwl\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") " pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:49.039956 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.039910    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b359f26-a19e-497f-ab1e-0aa71d097b02-data\") pod \"seaweedfs-64568bcd49-g9kxn\" (UID: \"3b359f26-a19e-497f-ab1e-0aa71d097b02\") " pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:49.040154 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.039973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmzqn\" (UniqueName: \"kubernetes.io/projected/3b359f26-a19e-497f-ab1e-0aa71d097b02-kube-api-access-xmzqn\") pod \"seaweedfs-64568bcd49-g9kxn\" (UID: \"3b359f26-a19e-497f-ab1e-0aa71d097b02\") " pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:49.040431 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.040406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b359f26-a19e-497f-ab1e-0aa71d097b02-data\") pod \"seaweedfs-64568bcd49-g9kxn\" (UID: \"3b359f26-a19e-497f-ab1e-0aa71d097b02\") " pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:49.052569 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.052515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmzqn\" (UniqueName: \"kubernetes.io/projected/3b359f26-a19e-497f-ab1e-0aa71d097b02-kube-api-access-xmzqn\") pod \"seaweedfs-64568bcd49-g9kxn\" (UID: \"3b359f26-a19e-497f-ab1e-0aa71d097b02\") " pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:49.111008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.110971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:49.165220 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.165179    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:49.294697 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.294664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:49.310662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.310627    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-g9kxn"]
Jul 09 17:46:49.313738 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:46:49.313705    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b359f26_a19e_497f_ab1e_0aa71d097b02.slice/crio-b3207e736508cc1d0d9436221e4f5bd59da5ebe3b690f3eb7090039bc15e6245 WatchSource:0}: Error finding container b3207e736508cc1d0d9436221e4f5bd59da5ebe3b690f3eb7090039bc15e6245: Status 404 returned error can't find the container with id b3207e736508cc1d0d9436221e4f5bd59da5ebe3b690f3eb7090039bc15e6245
Jul 09 17:46:49.443807 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.443766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert\") pod \"kserve-controller-manager-6b8548bc6d-wmkwl\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") " pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:49.446295 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.446268    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert\") pod \"kserve-controller-manager-6b8548bc6d-wmkwl\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") " pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:49.697715 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.697670    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:49.850135 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.850103    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-wmkwl"]
Jul 09 17:46:49.853320 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:46:49.853283    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff0a1ff_9dbd_4602_8e33_1f81f0c6e8a7.slice/crio-51233d76326e8126f3dd426b6ff90dc0a32762de96b6d6cdf32022b107992bff WatchSource:0}: Error finding container 51233d76326e8126f3dd426b6ff90dc0a32762de96b6d6cdf32022b107992bff: Status 404 returned error can't find the container with id 51233d76326e8126f3dd426b6ff90dc0a32762de96b6d6cdf32022b107992bff
Jul 09 17:46:49.906485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.906444    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl" event={"ID":"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7","Type":"ContainerStarted","Data":"51233d76326e8126f3dd426b6ff90dc0a32762de96b6d6cdf32022b107992bff"}
Jul 09 17:46:49.908566 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:49.908507    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-g9kxn" event={"ID":"3b359f26-a19e-497f-ab1e-0aa71d097b02","Type":"ContainerStarted","Data":"b3207e736508cc1d0d9436221e4f5bd59da5ebe3b690f3eb7090039bc15e6245"}
Jul 09 17:46:50.767515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:50.767470    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:50.836232 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:50.836150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:53.932389 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:53.932345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl" event={"ID":"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7","Type":"ContainerStarted","Data":"2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7"}
Jul 09 17:46:53.932901 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:53.932450    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:46:53.934014 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:53.933973    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-g9kxn" event={"ID":"3b359f26-a19e-497f-ab1e-0aa71d097b02","Type":"ContainerStarted","Data":"470c6a89fa1bd276f4914ce25b91f3df699b0610a6aeb55ba79d451de3b07a4a"}
Jul 09 17:46:53.934164 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:53.934110    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:53.950866 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:53.950805    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl" podStartSLOduration=2.32869639 podStartE2EDuration="5.950785518s" totalImagesPullingTime="3.622089128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:46:53.950573554 +0000 UTC m=+467.995870059" watchObservedRunningTime="2026-07-09 17:46:53.950785518 +0000 UTC m=+467.996082030"
Jul 09 17:46:58.476808 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:58.476766    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:59.941200 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:59.941168    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-g9kxn"
Jul 09 17:46:59.961671 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:46:59.961616    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-g9kxn" podStartSLOduration=7.706440627 podStartE2EDuration="11.961598383s" totalImagesPullingTime="4.255157756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:46:53.968508616 +0000 UTC m=+468.013805128" watchObservedRunningTime="2026-07-09 17:46:59.961598383 +0000 UTC m=+474.006894893"
Jul 09 17:47:18.111338 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.111300    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bdf4df5b-jxd89"]
Jul 09 17:47:18.114808 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.114770    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.126919 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.126886    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bdf4df5b-jxd89"]
Jul 09 17:47:18.193157 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.193121    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ff02642-1a82-42e6-badd-3969351042c8-console-serving-cert\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.193157 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.193158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ff02642-1a82-42e6-badd-3969351042c8-console-oauth-config\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.193402 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.193178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-service-ca\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.193402 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.193260    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976n8\" (UniqueName: \"kubernetes.io/projected/0ff02642-1a82-42e6-badd-3969351042c8-kube-api-access-976n8\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.193402 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.193344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-oauth-serving-cert\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.193402 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.193372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-trusted-ca-bundle\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.193402 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.193401    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-console-config\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.207469 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.207430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:18.273018 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.272981    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:18.294798 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.294762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-trusted-ca-bundle\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.294915 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.294809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-console-config\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.294915 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.294862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ff02642-1a82-42e6-badd-3969351042c8-console-serving-cert\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.294915 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.294880    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ff02642-1a82-42e6-badd-3969351042c8-console-oauth-config\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.294915 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.294894    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-service-ca\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.295129 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.294932    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-976n8\" (UniqueName: \"kubernetes.io/projected/0ff02642-1a82-42e6-badd-3969351042c8-kube-api-access-976n8\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.295129 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.294984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-oauth-serving-cert\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.295788 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.295758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-service-ca\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.295894 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.295762    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-oauth-serving-cert\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.295894 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.295807    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-console-config\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.295894 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.295865    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ff02642-1a82-42e6-badd-3969351042c8-trusted-ca-bundle\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.297574 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.297548    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ff02642-1a82-42e6-badd-3969351042c8-console-oauth-config\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.297791 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.297772    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ff02642-1a82-42e6-badd-3969351042c8-console-serving-cert\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.304936 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.304910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-976n8\" (UniqueName: \"kubernetes.io/projected/0ff02642-1a82-42e6-badd-3969351042c8-kube-api-access-976n8\") pod \"console-6bdf4df5b-jxd89\" (UID: \"0ff02642-1a82-42e6-badd-3969351042c8\") " pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.425030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.424991    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:18.568355 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:18.568120    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bdf4df5b-jxd89"]
Jul 09 17:47:18.571098 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:47:18.571062    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff02642_1a82_42e6_badd_3969351042c8.slice/crio-9db40ef7e41cbec6d34f57dcb089bec251c5c5245fbcfcb115cd7b9e862d09c0 WatchSource:0}: Error finding container 9db40ef7e41cbec6d34f57dcb089bec251c5c5245fbcfcb115cd7b9e862d09c0: Status 404 returned error can't find the container with id 9db40ef7e41cbec6d34f57dcb089bec251c5c5245fbcfcb115cd7b9e862d09c0
Jul 09 17:47:19.043864 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:19.043823    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bdf4df5b-jxd89" event={"ID":"0ff02642-1a82-42e6-badd-3969351042c8","Type":"ContainerStarted","Data":"8525756280c9b27c76264e9bd0d0e93c8c1db403217ca813402916f2730d0476"}
Jul 09 17:47:19.044054 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:19.043882    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bdf4df5b-jxd89" event={"ID":"0ff02642-1a82-42e6-badd-3969351042c8","Type":"ContainerStarted","Data":"9db40ef7e41cbec6d34f57dcb089bec251c5c5245fbcfcb115cd7b9e862d09c0"}
Jul 09 17:47:19.064041 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:19.063985    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bdf4df5b-jxd89" podStartSLOduration=1.063965345 podStartE2EDuration="1.063965345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:47:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:47:19.062946838 +0000 UTC m=+493.108243349" watchObservedRunningTime="2026-07-09 17:47:19.063965345 +0000 UTC m=+493.109261919"
Jul 09 17:47:24.945003 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:24.944967    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:47:26.205569 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.205509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:26.304490 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.304448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:26.489435 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.489354    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"]
Jul 09 17:47:26.540519 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.540477    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"]
Jul 09 17:47:26.540716 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.540639    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.543325 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.543301    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 17:47:26.543977 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.543959    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 17:47:26.543977 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.543967    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qv4q5\""
Jul 09 17:47:26.667386 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.667345    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.667628 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.667447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s47f8\" (UniqueName: \"kubernetes.io/projected/6011d9cb-3e35-456b-a2d4-a811341a29b3-kube-api-access-s47f8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.667628 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.667480    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.768957 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.768862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s47f8\" (UniqueName: \"kubernetes.io/projected/6011d9cb-3e35-456b-a2d4-a811341a29b3-kube-api-access-s47f8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.768957 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.768906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.769174 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.769032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.769298 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.769265    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.769298 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.769289    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.779595 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.779564    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s47f8\" (UniqueName: \"kubernetes.io/projected/6011d9cb-3e35-456b-a2d4-a811341a29b3-kube-api-access-s47f8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:26.852030 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:26.851994    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:27.013405 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:27.013377    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"]
Jul 09 17:47:27.016065 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:47:27.016032    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6011d9cb_3e35_456b_a2d4_a811341a29b3.slice/crio-3df34a673bf08a7a1c4a64105e25a5cb29da1fff116558136d2d037e79b9740d WatchSource:0}: Error finding container 3df34a673bf08a7a1c4a64105e25a5cb29da1fff116558136d2d037e79b9740d: Status 404 returned error can't find the container with id 3df34a673bf08a7a1c4a64105e25a5cb29da1fff116558136d2d037e79b9740d
Jul 09 17:47:27.081019 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:27.080987    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m" event={"ID":"6011d9cb-3e35-456b-a2d4-a811341a29b3","Type":"ContainerStarted","Data":"3df34a673bf08a7a1c4a64105e25a5cb29da1fff116558136d2d037e79b9740d"}
Jul 09 17:47:28.086976 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:28.086880    2569 generic.go:356] "Generic (PLEG): container finished" podID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerID="08336fe39361188170283748f7598d1c6242f3713dfafec73830fcc47d9d7a46" exitCode=0
Jul 09 17:47:28.087346 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:28.086975    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m" event={"ID":"6011d9cb-3e35-456b-a2d4-a811341a29b3","Type":"ContainerDied","Data":"08336fe39361188170283748f7598d1c6242f3713dfafec73830fcc47d9d7a46"}
Jul 09 17:47:28.425592 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:28.425552    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:28.425784 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:28.425611    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:28.430749 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:28.430721    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:29.093572 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:29.093539    2569 generic.go:356] "Generic (PLEG): container finished" podID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerID="501bf2a61ee9c6ab092c677a892b4a36148e17624756535941f3d214da0fbaa3" exitCode=0
Jul 09 17:47:29.093978 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:29.093620    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m" event={"ID":"6011d9cb-3e35-456b-a2d4-a811341a29b3","Type":"ContainerDied","Data":"501bf2a61ee9c6ab092c677a892b4a36148e17624756535941f3d214da0fbaa3"}
Jul 09 17:47:29.098130 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:29.098112    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bdf4df5b-jxd89"
Jul 09 17:47:29.176323 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:29.176280    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c8fc5db96-6h59v"]
Jul 09 17:47:29.307817 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:29.304978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:29.406129 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:29.406092    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:29.474018 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:29.473981    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:30.099672 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:30.099639    2569 generic.go:356] "Generic (PLEG): container finished" podID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerID="836022db7002fa7232839f57ebdda622f063d470e079f5769f35288818fb16de" exitCode=0
Jul 09 17:47:30.100097 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:30.099718    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m" event={"ID":"6011d9cb-3e35-456b-a2d4-a811341a29b3","Type":"ContainerDied","Data":"836022db7002fa7232839f57ebdda622f063d470e079f5769f35288818fb16de"}
Jul 09 17:47:31.238865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.238835    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:31.409488 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.409457    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-util\") pod \"6011d9cb-3e35-456b-a2d4-a811341a29b3\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") "
Jul 09 17:47:31.409677 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.409564    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s47f8\" (UniqueName: \"kubernetes.io/projected/6011d9cb-3e35-456b-a2d4-a811341a29b3-kube-api-access-s47f8\") pod \"6011d9cb-3e35-456b-a2d4-a811341a29b3\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") "
Jul 09 17:47:31.409677 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.409605    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-bundle\") pod \"6011d9cb-3e35-456b-a2d4-a811341a29b3\" (UID: \"6011d9cb-3e35-456b-a2d4-a811341a29b3\") "
Jul 09 17:47:31.410343 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.410316    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-bundle" (OuterVolumeSpecName: "bundle") pod "6011d9cb-3e35-456b-a2d4-a811341a29b3" (UID: "6011d9cb-3e35-456b-a2d4-a811341a29b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:47:31.411804 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.411779    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6011d9cb-3e35-456b-a2d4-a811341a29b3-kube-api-access-s47f8" (OuterVolumeSpecName: "kube-api-access-s47f8") pod "6011d9cb-3e35-456b-a2d4-a811341a29b3" (UID: "6011d9cb-3e35-456b-a2d4-a811341a29b3"). InnerVolumeSpecName "kube-api-access-s47f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:47:31.415519 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.415492    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-util" (OuterVolumeSpecName: "util") pod "6011d9cb-3e35-456b-a2d4-a811341a29b3" (UID: "6011d9cb-3e35-456b-a2d4-a811341a29b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:47:31.510568 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.510502    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:31.510568 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.510559    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6011d9cb-3e35-456b-a2d4-a811341a29b3-util\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:31.510568 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:31.510569    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s47f8\" (UniqueName: \"kubernetes.io/projected/6011d9cb-3e35-456b-a2d4-a811341a29b3-kube-api-access-s47f8\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:32.110803 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:32.110768    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m" event={"ID":"6011d9cb-3e35-456b-a2d4-a811341a29b3","Type":"ContainerDied","Data":"3df34a673bf08a7a1c4a64105e25a5cb29da1fff116558136d2d037e79b9740d"}
Jul 09 17:47:32.111004 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:32.110840    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3df34a673bf08a7a1c4a64105e25a5cb29da1fff116558136d2d037e79b9740d"
Jul 09 17:47:32.111004 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:32.110846    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tp2m"
Jul 09 17:47:37.667537 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:37.667494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:38.919373 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:38.919335    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:41.220134 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:41.220098    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:41.320919 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:41.320888    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:44.679288 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:44.679252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:44.788059 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:44.788023    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:46.254185 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:46.254150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:46.314292 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:46.314258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:47.065505 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:47.065474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:47.288208 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:47.288116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:47.869959 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:47.869922    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:47.967727 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:47.967693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:48.067749 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.067709    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:48.128161 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128128    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"]
Jul 09 17:47:48.128470 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128457    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerName="pull"
Jul 09 17:47:48.128549 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128472    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerName="pull"
Jul 09 17:47:48.128549 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128482    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerName="extract"
Jul 09 17:47:48.128549 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128488    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerName="extract"
Jul 09 17:47:48.128549 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128497    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerName="util"
Jul 09 17:47:48.128549 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128504    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerName="util"
Jul 09 17:47:48.128708 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.128580    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6011d9cb-3e35-456b-a2d4-a811341a29b3" containerName="extract"
Jul 09 17:47:48.131872 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.131853    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.134165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.134143    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 17:47:48.134379 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.134366    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qv4q5\""
Jul 09 17:47:48.134474 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.134453    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 17:47:48.140662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.140641    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.140768 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.140735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.140809 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.140771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxkt8\" (UniqueName: \"kubernetes.io/projected/d5081307-fff8-476a-aa8a-6a28e2a31ade-kube-api-access-hxkt8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.146363 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.146326    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"]
Jul 09 17:47:48.241988 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.241952    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.242174 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.242013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxkt8\" (UniqueName: \"kubernetes.io/projected/d5081307-fff8-476a-aa8a-6a28e2a31ade-kube-api-access-hxkt8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.242174 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.242067    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.242420 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.242398    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.242458 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.242411    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.251177 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.251143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxkt8\" (UniqueName: \"kubernetes.io/projected/d5081307-fff8-476a-aa8a-6a28e2a31ade-kube-api-access-hxkt8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.441455 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.441349    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:48.593715 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:48.593684    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"]
Jul 09 17:47:48.596133 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:47:48.596105    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5081307_fff8_476a_aa8a_6a28e2a31ade.slice/crio-066143af85886d744c75a22786f8c0f578bdc80257741a81392999eb75b80362 WatchSource:0}: Error finding container 066143af85886d744c75a22786f8c0f578bdc80257741a81392999eb75b80362: Status 404 returned error can't find the container with id 066143af85886d744c75a22786f8c0f578bdc80257741a81392999eb75b80362
Jul 09 17:47:49.191426 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:49.191390    2569 generic.go:356] "Generic (PLEG): container finished" podID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerID="c8d4c2832060c04ad98abe27a1916d12da5c735cd3a49472599c30f149bb3911" exitCode=0
Jul 09 17:47:49.191705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:49.191473    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg" event={"ID":"d5081307-fff8-476a-aa8a-6a28e2a31ade","Type":"ContainerDied","Data":"c8d4c2832060c04ad98abe27a1916d12da5c735cd3a49472599c30f149bb3911"}
Jul 09 17:47:49.191705 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:49.191549    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg" event={"ID":"d5081307-fff8-476a-aa8a-6a28e2a31ade","Type":"ContainerStarted","Data":"066143af85886d744c75a22786f8c0f578bdc80257741a81392999eb75b80362"}
Jul 09 17:47:51.204763 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:51.204725    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg" event={"ID":"d5081307-fff8-476a-aa8a-6a28e2a31ade","Type":"ContainerStarted","Data":"8ca2b52872522cbe817474dbf6621e7dd5f2a8ce6e54e0407f747a22f5b6dcc0"}
Jul 09 17:47:52.210552 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:52.210489    2569 generic.go:356] "Generic (PLEG): container finished" podID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerID="8ca2b52872522cbe817474dbf6621e7dd5f2a8ce6e54e0407f747a22f5b6dcc0" exitCode=0
Jul 09 17:47:52.210948 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:52.210575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg" event={"ID":"d5081307-fff8-476a-aa8a-6a28e2a31ade","Type":"ContainerDied","Data":"8ca2b52872522cbe817474dbf6621e7dd5f2a8ce6e54e0407f747a22f5b6dcc0"}
Jul 09 17:47:53.217063 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:53.217029    2569 generic.go:356] "Generic (PLEG): container finished" podID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerID="01bf33ea149f97ee3f1167dc1a6c5b994071c89866e068244c3ca08111282acb" exitCode=0
Jul 09 17:47:53.217466 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:53.217078    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg" event={"ID":"d5081307-fff8-476a-aa8a-6a28e2a31ade","Type":"ContainerDied","Data":"01bf33ea149f97ee3f1167dc1a6c5b994071c89866e068244c3ca08111282acb"}
Jul 09 17:47:54.205277 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.205227    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c8fc5db96-6h59v" podUID="90496c4a-ae33-46fa-90cd-de7b70ee10f6" containerName="console" containerID="cri-o://4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57" gracePeriod=15
Jul 09 17:47:54.304226 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.304188    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:54.359959 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.359928    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:54.383758 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.383728    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxkt8\" (UniqueName: \"kubernetes.io/projected/d5081307-fff8-476a-aa8a-6a28e2a31ade-kube-api-access-hxkt8\") pod \"d5081307-fff8-476a-aa8a-6a28e2a31ade\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") "
Jul 09 17:47:54.384004 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.383845    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-bundle\") pod \"d5081307-fff8-476a-aa8a-6a28e2a31ade\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") "
Jul 09 17:47:54.384004 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.383885    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-util\") pod \"d5081307-fff8-476a-aa8a-6a28e2a31ade\" (UID: \"d5081307-fff8-476a-aa8a-6a28e2a31ade\") "
Jul 09 17:47:54.384520 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.384390    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-bundle" (OuterVolumeSpecName: "bundle") pod "d5081307-fff8-476a-aa8a-6a28e2a31ade" (UID: "d5081307-fff8-476a-aa8a-6a28e2a31ade"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:47:54.387307 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.387278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5081307-fff8-476a-aa8a-6a28e2a31ade-kube-api-access-hxkt8" (OuterVolumeSpecName: "kube-api-access-hxkt8") pod "d5081307-fff8-476a-aa8a-6a28e2a31ade" (UID: "d5081307-fff8-476a-aa8a-6a28e2a31ade"). InnerVolumeSpecName "kube-api-access-hxkt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:47:54.390208 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.390172    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-util" (OuterVolumeSpecName: "util") pod "d5081307-fff8-476a-aa8a-6a28e2a31ade" (UID: "d5081307-fff8-476a-aa8a-6a28e2a31ade"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:47:54.465354 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.465282    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:47:54.484485 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484459    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-oauth-serving-cert\") pod \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") "
Jul 09 17:47:54.484650 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484493    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-trusted-ca-bundle\") pod \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") "
Jul 09 17:47:54.484650 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484511    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-oauth-config\") pod \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") "
Jul 09 17:47:54.484650 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484548    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbfgn\" (UniqueName: \"kubernetes.io/projected/90496c4a-ae33-46fa-90cd-de7b70ee10f6-kube-api-access-pbfgn\") pod \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") "
Jul 09 17:47:54.484650 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484575    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-config\") pod \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") "
Jul 09 17:47:54.484650 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484608    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-service-ca\") pod \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") "
Jul 09 17:47:54.484888 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484678    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-serving-cert\") pod \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\" (UID: \"90496c4a-ae33-46fa-90cd-de7b70ee10f6\") "
Jul 09 17:47:54.484888 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484878    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-util\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.485000 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484897    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxkt8\" (UniqueName: \"kubernetes.io/projected/d5081307-fff8-476a-aa8a-6a28e2a31ade-kube-api-access-hxkt8\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.485000 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484911    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5081307-fff8-476a-aa8a-6a28e2a31ade-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.485000 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.484934    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90496c4a-ae33-46fa-90cd-de7b70ee10f6" (UID: "90496c4a-ae33-46fa-90cd-de7b70ee10f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:47:54.485150 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.485124    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90496c4a-ae33-46fa-90cd-de7b70ee10f6" (UID: "90496c4a-ae33-46fa-90cd-de7b70ee10f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:47:54.485232 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.485208    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "90496c4a-ae33-46fa-90cd-de7b70ee10f6" (UID: "90496c4a-ae33-46fa-90cd-de7b70ee10f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:47:54.485323 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.485300    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-config" (OuterVolumeSpecName: "console-config") pod "90496c4a-ae33-46fa-90cd-de7b70ee10f6" (UID: "90496c4a-ae33-46fa-90cd-de7b70ee10f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:47:54.486914 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.486880    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90496c4a-ae33-46fa-90cd-de7b70ee10f6" (UID: "90496c4a-ae33-46fa-90cd-de7b70ee10f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:47:54.487311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.487282    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90496c4a-ae33-46fa-90cd-de7b70ee10f6" (UID: "90496c4a-ae33-46fa-90cd-de7b70ee10f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:47:54.487473 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.487306    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90496c4a-ae33-46fa-90cd-de7b70ee10f6-kube-api-access-pbfgn" (OuterVolumeSpecName: "kube-api-access-pbfgn") pod "90496c4a-ae33-46fa-90cd-de7b70ee10f6" (UID: "90496c4a-ae33-46fa-90cd-de7b70ee10f6"). InnerVolumeSpecName "kube-api-access-pbfgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:47:54.585467 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.585422    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-oauth-serving-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.585467 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.585460    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-trusted-ca-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.585753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.585493    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-oauth-config\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.585753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.585555    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbfgn\" (UniqueName: \"kubernetes.io/projected/90496c4a-ae33-46fa-90cd-de7b70ee10f6-kube-api-access-pbfgn\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.585753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.585574    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-config\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.585753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.585590    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90496c4a-ae33-46fa-90cd-de7b70ee10f6-service-ca\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:54.585753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:54.585604    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90496c4a-ae33-46fa-90cd-de7b70ee10f6-console-serving-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:47:55.227737 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.227703    2569 generic.go:356] "Generic (PLEG): container finished" podID="90496c4a-ae33-46fa-90cd-de7b70ee10f6" containerID="4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57" exitCode=0
Jul 09 17:47:55.227905 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.227765    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8fc5db96-6h59v"
Jul 09 17:47:55.227905 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.227790    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8fc5db96-6h59v" event={"ID":"90496c4a-ae33-46fa-90cd-de7b70ee10f6","Type":"ContainerDied","Data":"4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57"}
Jul 09 17:47:55.227905 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.227840    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8fc5db96-6h59v" event={"ID":"90496c4a-ae33-46fa-90cd-de7b70ee10f6","Type":"ContainerDied","Data":"94db146ffaf0690993397a09ef03af7b7cdcb7aea7c4443ad91e2cbf8c3d12a0"}
Jul 09 17:47:55.227905 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.227863    2569 scope.go:117] "RemoveContainer" containerID="4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57"
Jul 09 17:47:55.230015 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.229988    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg" event={"ID":"d5081307-fff8-476a-aa8a-6a28e2a31ade","Type":"ContainerDied","Data":"066143af85886d744c75a22786f8c0f578bdc80257741a81392999eb75b80362"}
Jul 09 17:47:55.230144 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.230072    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="066143af85886d744c75a22786f8c0f578bdc80257741a81392999eb75b80362"
Jul 09 17:47:55.230144 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.229996    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flddzg"
Jul 09 17:47:55.236770 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.236751    2569 scope.go:117] "RemoveContainer" containerID="4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57"
Jul 09 17:47:55.237052 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:47:55.237027    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57\": container with ID starting with 4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57 not found: ID does not exist" containerID="4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57"
Jul 09 17:47:55.237164 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.237059    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57"} err="failed to get container status \"4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57\": rpc error: code = NotFound desc = could not find container \"4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57\": container with ID starting with 4af0ecb53b918db985022ffac9c0c8088663f97e51f502787aa68733b7025f57 not found: ID does not exist"
Jul 09 17:47:55.246182 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.246157    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c8fc5db96-6h59v"]
Jul 09 17:47:55.247825 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:55.247802    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c8fc5db96-6h59v"]
Jul 09 17:47:56.500071 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:56.500035    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90496c4a-ae33-46fa-90cd-de7b70ee10f6" path="/var/lib/kubelet/pods/90496c4a-ae33-46fa-90cd-de7b70ee10f6/volumes"
Jul 09 17:47:59.599664 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:59.599557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:59.696230 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:47:59.696185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:11.479785 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:11.479746    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:16.833676 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.833645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:16.847540 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847497    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"]
Jul 09 17:48:16.847844 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847830    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90496c4a-ae33-46fa-90cd-de7b70ee10f6" containerName="console"
Jul 09 17:48:16.847898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847845    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90496c4a-ae33-46fa-90cd-de7b70ee10f6" containerName="console"
Jul 09 17:48:16.847898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847854    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerName="extract"
Jul 09 17:48:16.847898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847860    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerName="extract"
Jul 09 17:48:16.847898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847868    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerName="util"
Jul 09 17:48:16.847898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847874    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerName="util"
Jul 09 17:48:16.847898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847892    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerName="pull"
Jul 09 17:48:16.847898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847897    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerName="pull"
Jul 09 17:48:16.848095 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847949    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="90496c4a-ae33-46fa-90cd-de7b70ee10f6" containerName="console"
Jul 09 17:48:16.848095 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.847961    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5081307-fff8-476a-aa8a-6a28e2a31ade" containerName="extract"
Jul 09 17:48:16.853311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.853285    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:16.855536 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.855499    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 17:48:16.855673 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.855551    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jvsn7\""
Jul 09 17:48:16.855796 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.855781    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 17:48:16.855847 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.855821    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 17:48:16.856133 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.856116    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 17:48:16.865197 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.865168    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"]
Jul 09 17:48:16.906766 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.906728    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:16.959040 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.959000    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:16.959217 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.959058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/048c2191-0e89-4fe1-bcef-eb137d8dd186-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:16.959217 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.959088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9bd\" (UniqueName: \"kubernetes.io/projected/048c2191-0e89-4fe1-bcef-eb137d8dd186-kube-api-access-5r9bd\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:16.959217 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.959135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:16.959217 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.959156    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:16.959217 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.959178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:16.959217 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:16.959203    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.059897 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.059860    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.060088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.059906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.060088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.059947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/048c2191-0e89-4fe1-bcef-eb137d8dd186-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.060088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.059974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9bd\" (UniqueName: \"kubernetes.io/projected/048c2191-0e89-4fe1-bcef-eb137d8dd186-kube-api-access-5r9bd\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.060088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.060034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.060298 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.060085    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.060298 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.060137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.061038 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.061006    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.062315 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.062278    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.062502 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.062480    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.062613 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.062575    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/048c2191-0e89-4fe1-bcef-eb137d8dd186-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.062779 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.062757    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.074381 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.074347    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/048c2191-0e89-4fe1-bcef-eb137d8dd186-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.074501 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.074457    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9bd\" (UniqueName: \"kubernetes.io/projected/048c2191-0e89-4fe1-bcef-eb137d8dd186-kube-api-access-5r9bd\") pod \"istiod-openshift-gateway-94bb8fbfd-p9b99\" (UID: \"048c2191-0e89-4fe1-bcef-eb137d8dd186\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.163809 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.163774    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:17.326092 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.325910    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"]
Jul 09 17:48:17.328825 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:17.328794    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048c2191_0e89_4fe1_bcef_eb137d8dd186.slice/crio-06afa6f6cb382fdf88d3624076dc7846101e28756e3b5097649f5cd585f84b6b WatchSource:0}: Error finding container 06afa6f6cb382fdf88d3624076dc7846101e28756e3b5097649f5cd585f84b6b: Status 404 returned error can't find the container with id 06afa6f6cb382fdf88d3624076dc7846101e28756e3b5097649f5cd585f84b6b
Jul 09 17:48:17.336376 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:17.336335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99" event={"ID":"048c2191-0e89-4fe1-bcef-eb137d8dd186","Type":"ContainerStarted","Data":"06afa6f6cb382fdf88d3624076dc7846101e28756e3b5097649f5cd585f84b6b"}
Jul 09 17:48:18.075087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:18.075050    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:19.697286 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:19.697244    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:19.817609 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:19.817563    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 17:48:19.817677 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:19.817656    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 17:48:19.824768 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:19.824739    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:20.310388 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:20.310352    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:20.356971 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:20.356936    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99" event={"ID":"048c2191-0e89-4fe1-bcef-eb137d8dd186","Type":"ContainerStarted","Data":"6989c893b41845b014ccc27ef48fd6248ca4c602bafffc73a5ed73a57b208a88"}
Jul 09 17:48:20.357257 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:20.357108    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:20.359050 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:20.359023    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-p9b99 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 17:48:20.359205 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:20.359076    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99" podUID="048c2191-0e89-4fe1-bcef-eb137d8dd186" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 17:48:20.381141 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:20.381082    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99" podStartSLOduration=1.894693588 podStartE2EDuration="4.381065223s" totalImagesPullingTime="2.486371635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:48:20.379387694 +0000 UTC m=+554.424684217" watchObservedRunningTime="2026-07-09 17:48:20.381065223 +0000 UTC m=+554.426361734"
Jul 09 17:48:20.410678 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:20.410642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:21.362243 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:21.362219    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99"
Jul 09 17:48:23.284790 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:23.284755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:23.351836 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:23.351799    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:26.585178 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:26.585149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:30.870848 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:30.870810    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:30.960135 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:30.960097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:32.044339 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:32.044305    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:32.147968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:32.147932    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:34.693303 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.693263    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"]
Jul 09 17:48:34.699167 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.699144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.701682 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.701657    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 17:48:34.701906 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.701892    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qv4q5\""
Jul 09 17:48:34.702406 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.702390    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 17:48:34.712512 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.712477    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"]
Jul 09 17:48:34.821382 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.821329    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.821619 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.821417    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgz54\" (UniqueName: \"kubernetes.io/projected/d414c385-84d9-4599-a466-06d3354d2a45-kube-api-access-vgz54\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.821619 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.821443    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.839276 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.839237    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"]
Jul 09 17:48:34.843038 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.843018    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:34.860662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.860629    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"]
Jul 09 17:48:34.919065 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.919026    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"]
Jul 09 17:48:34.922175 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.922252 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922202    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:34.922252 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922234    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:34.922333 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922253    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.922333 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slfvp\" (UniqueName: \"kubernetes.io/projected/18bd71e7-55d1-4e1d-b103-e24cccb089c8-kube-api-access-slfvp\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:34.922408 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgz54\" (UniqueName: \"kubernetes.io/projected/d414c385-84d9-4599-a466-06d3354d2a45-kube-api-access-vgz54\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.922542 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.922655 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922586    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.922753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.922737    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:34.931057 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.931015    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgz54\" (UniqueName: \"kubernetes.io/projected/d414c385-84d9-4599-a466-06d3354d2a45-kube-api-access-vgz54\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:34.933412 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.933386    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"]
Jul 09 17:48:34.985339 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.985249    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"]
Jul 09 17:48:34.989232 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:34.989210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.002047 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.002014    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"]
Jul 09 17:48:35.008882 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.008850    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:35.023625 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.023588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.023786 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.023635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttw57\" (UniqueName: \"kubernetes.io/projected/7fbd5472-8099-431d-8717-268d2a5ffabd-kube-api-access-ttw57\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.023786 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.023683    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.023786 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.023761    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:35.023945 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.023840    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:35.023945 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.023879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slfvp\" (UniqueName: \"kubernetes.io/projected/18bd71e7-55d1-4e1d-b103-e24cccb089c8-kube-api-access-slfvp\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:35.024237 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.024196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:35.024327 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.024262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:35.033633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.033596    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slfvp\" (UniqueName: \"kubernetes.io/projected/18bd71e7-55d1-4e1d-b103-e24cccb089c8-kube-api-access-slfvp\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:35.125327 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125291    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.125327 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttw57\" (UniqueName: \"kubernetes.io/projected/7fbd5472-8099-431d-8717-268d2a5ffabd-kube-api-access-ttw57\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.125605 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.125605 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125404    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxg7w\" (UniqueName: \"kubernetes.io/projected/2375e997-4827-4c49-8776-76be9a73daad-kube-api-access-rxg7w\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.125605 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.125605 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125452    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.125813 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125768    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.125889 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.125867    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.134745 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.134707    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttw57\" (UniqueName: \"kubernetes.io/projected/7fbd5472-8099-431d-8717-268d2a5ffabd-kube-api-access-ttw57\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.152851 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.152817    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:35.153967 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.153937    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"]
Jul 09 17:48:35.156575 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:35.156548    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd414c385_84d9_4599_a466_06d3354d2a45.slice/crio-b53d20b8ad45139f75d3f89b3b76ed5bfc7844c46463a8f7aff080d31e54e8fe WatchSource:0}: Error finding container b53d20b8ad45139f75d3f89b3b76ed5bfc7844c46463a8f7aff080d31e54e8fe: Status 404 returned error can't find the container with id b53d20b8ad45139f75d3f89b3b76ed5bfc7844c46463a8f7aff080d31e54e8fe
Jul 09 17:48:35.226883 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.226828    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxg7w\" (UniqueName: \"kubernetes.io/projected/2375e997-4827-4c49-8776-76be9a73daad-kube-api-access-rxg7w\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.227067 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.226903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.227067 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.226949    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.227370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.227344    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.227422 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.227390    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.232358 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.232333    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:35.236587 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.236563    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxg7w\" (UniqueName: \"kubernetes.io/projected/2375e997-4827-4c49-8776-76be9a73daad-kube-api-access-rxg7w\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.300318 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.300030    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:35.306807 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.306776    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"]
Jul 09 17:48:35.332898 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:35.332838    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bd71e7_55d1_4e1d_b103_e24cccb089c8.slice/crio-9ce4c92d82e25f9011a5d10db6fea7ec32af80a560346b4d37fd6c6a15e63972 WatchSource:0}: Error finding container 9ce4c92d82e25f9011a5d10db6fea7ec32af80a560346b4d37fd6c6a15e63972: Status 404 returned error can't find the container with id 9ce4c92d82e25f9011a5d10db6fea7ec32af80a560346b4d37fd6c6a15e63972
Jul 09 17:48:35.394660 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.394632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"]
Jul 09 17:48:35.395814 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:35.395790    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbd5472_8099_431d_8717_268d2a5ffabd.slice/crio-a9abf267bb95a173de0e43893352aee0a3439c1a25cce5e1a2306feba292c0c8 WatchSource:0}: Error finding container a9abf267bb95a173de0e43893352aee0a3439c1a25cce5e1a2306feba292c0c8: Status 404 returned error can't find the container with id a9abf267bb95a173de0e43893352aee0a3439c1a25cce5e1a2306feba292c0c8
Jul 09 17:48:35.449048 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.449003    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h" event={"ID":"18bd71e7-55d1-4e1d-b103-e24cccb089c8","Type":"ContainerStarted","Data":"512848d155e020d13722dd364930c9865af16eac210fbbd3cffabab0f0a4c7cd"}
Jul 09 17:48:35.450233 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.449921    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h" event={"ID":"18bd71e7-55d1-4e1d-b103-e24cccb089c8","Type":"ContainerStarted","Data":"9ce4c92d82e25f9011a5d10db6fea7ec32af80a560346b4d37fd6c6a15e63972"}
Jul 09 17:48:35.451433 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.451349    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x" event={"ID":"7fbd5472-8099-431d-8717-268d2a5ffabd","Type":"ContainerStarted","Data":"a9abf267bb95a173de0e43893352aee0a3439c1a25cce5e1a2306feba292c0c8"}
Jul 09 17:48:35.453762 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.453728    2569 generic.go:356] "Generic (PLEG): container finished" podID="d414c385-84d9-4599-a466-06d3354d2a45" containerID="8fad61343b846a3991a86b734cff919de4a242da9905c4210eaa6fb8d6559836" exitCode=0
Jul 09 17:48:35.453908 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.453772    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b" event={"ID":"d414c385-84d9-4599-a466-06d3354d2a45","Type":"ContainerDied","Data":"8fad61343b846a3991a86b734cff919de4a242da9905c4210eaa6fb8d6559836"}
Jul 09 17:48:35.453908 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.453806    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b" event={"ID":"d414c385-84d9-4599-a466-06d3354d2a45","Type":"ContainerStarted","Data":"b53d20b8ad45139f75d3f89b3b76ed5bfc7844c46463a8f7aff080d31e54e8fe"}
Jul 09 17:48:35.494662 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:35.494633    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"]
Jul 09 17:48:35.542967 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:35.542938    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2375e997_4827_4c49_8776_76be9a73daad.slice/crio-4b880cd135334c2cabbe330f795b746b11ceb3880cad993cd2e45f76441d414b WatchSource:0}: Error finding container 4b880cd135334c2cabbe330f795b746b11ceb3880cad993cd2e45f76441d414b: Status 404 returned error can't find the container with id 4b880cd135334c2cabbe330f795b746b11ceb3880cad993cd2e45f76441d414b
Jul 09 17:48:36.462013 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:36.461978    2569 generic.go:356] "Generic (PLEG): container finished" podID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerID="f42499ff1d10a78aac4fba2337bbd8b4f9709360df2ce1f3700bd02cd2085ab6" exitCode=0
Jul 09 17:48:36.462464 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:36.462073    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x" event={"ID":"7fbd5472-8099-431d-8717-268d2a5ffabd","Type":"ContainerDied","Data":"f42499ff1d10a78aac4fba2337bbd8b4f9709360df2ce1f3700bd02cd2085ab6"}
Jul 09 17:48:36.464029 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:36.464004    2569 generic.go:356] "Generic (PLEG): container finished" podID="2375e997-4827-4c49-8776-76be9a73daad" containerID="0d9196d3e149d9bb6dfec634013d4b4c5d3a768efaac61f921356c35b31cbe71" exitCode=0
Jul 09 17:48:36.464119 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:36.464043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76" event={"ID":"2375e997-4827-4c49-8776-76be9a73daad","Type":"ContainerDied","Data":"0d9196d3e149d9bb6dfec634013d4b4c5d3a768efaac61f921356c35b31cbe71"}
Jul 09 17:48:36.464119 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:36.464102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76" event={"ID":"2375e997-4827-4c49-8776-76be9a73daad","Type":"ContainerStarted","Data":"4b880cd135334c2cabbe330f795b746b11ceb3880cad993cd2e45f76441d414b"}
Jul 09 17:48:36.465974 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:36.465952    2569 generic.go:356] "Generic (PLEG): container finished" podID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerID="512848d155e020d13722dd364930c9865af16eac210fbbd3cffabab0f0a4c7cd" exitCode=0
Jul 09 17:48:36.466089 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:36.466008    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h" event={"ID":"18bd71e7-55d1-4e1d-b103-e24cccb089c8","Type":"ContainerDied","Data":"512848d155e020d13722dd364930c9865af16eac210fbbd3cffabab0f0a4c7cd"}
Jul 09 17:48:37.474239 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:37.474200    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76" event={"ID":"2375e997-4827-4c49-8776-76be9a73daad","Type":"ContainerStarted","Data":"e8783f16b034a70d483e07b35b0e8107273561594c00657f0adfa0522bece92b"}
Jul 09 17:48:37.476638 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:37.476609    2569 generic.go:356] "Generic (PLEG): container finished" podID="d414c385-84d9-4599-a466-06d3354d2a45" containerID="db611ce7dae8fc990226576964a30a9cbc8eb94f1387c8125e23b5b8110cfad1" exitCode=0
Jul 09 17:48:37.476776 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:37.476654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b" event={"ID":"d414c385-84d9-4599-a466-06d3354d2a45","Type":"ContainerDied","Data":"db611ce7dae8fc990226576964a30a9cbc8eb94f1387c8125e23b5b8110cfad1"}
Jul 09 17:48:38.483219 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.483186    2569 generic.go:356] "Generic (PLEG): container finished" podID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerID="ce0a015c6beb2c7a7dbf5b263c9da4a7bf050c5234763c0c69b688ad50a3ff67" exitCode=0
Jul 09 17:48:38.483685 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.483274    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x" event={"ID":"7fbd5472-8099-431d-8717-268d2a5ffabd","Type":"ContainerDied","Data":"ce0a015c6beb2c7a7dbf5b263c9da4a7bf050c5234763c0c69b688ad50a3ff67"}
Jul 09 17:48:38.485612 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.485588    2569 generic.go:356] "Generic (PLEG): container finished" podID="d414c385-84d9-4599-a466-06d3354d2a45" containerID="8bdbb041e742a5770e7c0b7b2d5d984dc0cf250098aadccd5f10b083ff65d074" exitCode=0
Jul 09 17:48:38.486165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.485672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b" event={"ID":"d414c385-84d9-4599-a466-06d3354d2a45","Type":"ContainerDied","Data":"8bdbb041e742a5770e7c0b7b2d5d984dc0cf250098aadccd5f10b083ff65d074"}
Jul 09 17:48:38.493019 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.492976    2569 generic.go:356] "Generic (PLEG): container finished" podID="2375e997-4827-4c49-8776-76be9a73daad" containerID="e8783f16b034a70d483e07b35b0e8107273561594c00657f0adfa0522bece92b" exitCode=0
Jul 09 17:48:38.493137 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.493083    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76" event={"ID":"2375e997-4827-4c49-8776-76be9a73daad","Type":"ContainerDied","Data":"e8783f16b034a70d483e07b35b0e8107273561594c00657f0adfa0522bece92b"}
Jul 09 17:48:38.495344 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.495319    2569 generic.go:356] "Generic (PLEG): container finished" podID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerID="0abb6d5bde2d77fa2ed637fa501457c23ff703708656da36452e4d11e0d700a8" exitCode=0
Jul 09 17:48:38.500667 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:38.500641    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h" event={"ID":"18bd71e7-55d1-4e1d-b103-e24cccb089c8","Type":"ContainerDied","Data":"0abb6d5bde2d77fa2ed637fa501457c23ff703708656da36452e4d11e0d700a8"}
Jul 09 17:48:39.503392 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.503354    2569 generic.go:356] "Generic (PLEG): container finished" podID="2375e997-4827-4c49-8776-76be9a73daad" containerID="dc6877fd5defac547b0fab38689fd72e950c7d7a1a3429adfe7520ccaffec334" exitCode=0
Jul 09 17:48:39.503867 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.503433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76" event={"ID":"2375e997-4827-4c49-8776-76be9a73daad","Type":"ContainerDied","Data":"dc6877fd5defac547b0fab38689fd72e950c7d7a1a3429adfe7520ccaffec334"}
Jul 09 17:48:39.505607 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.505581    2569 generic.go:356] "Generic (PLEG): container finished" podID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerID="380fe7fcca91c2c4c3147bfff42e29361cf3cecee9482ffa00377bf3f41fbc0d" exitCode=0
Jul 09 17:48:39.505729 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.505663    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h" event={"ID":"18bd71e7-55d1-4e1d-b103-e24cccb089c8","Type":"ContainerDied","Data":"380fe7fcca91c2c4c3147bfff42e29361cf3cecee9482ffa00377bf3f41fbc0d"}
Jul 09 17:48:39.507754 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.507732    2569 generic.go:356] "Generic (PLEG): container finished" podID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerID="1167c2c97c033400c50be834fd3e839095a8ba3badff4e29379a16973b58befe" exitCode=0
Jul 09 17:48:39.507865 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.507800    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x" event={"ID":"7fbd5472-8099-431d-8717-268d2a5ffabd","Type":"ContainerDied","Data":"1167c2c97c033400c50be834fd3e839095a8ba3badff4e29379a16973b58befe"}
Jul 09 17:48:39.641312 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.641285    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:39.780266 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.780228    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgz54\" (UniqueName: \"kubernetes.io/projected/d414c385-84d9-4599-a466-06d3354d2a45-kube-api-access-vgz54\") pod \"d414c385-84d9-4599-a466-06d3354d2a45\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") "
Jul 09 17:48:39.780460 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.780296    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-bundle\") pod \"d414c385-84d9-4599-a466-06d3354d2a45\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") "
Jul 09 17:48:39.780460 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.780339    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-util\") pod \"d414c385-84d9-4599-a466-06d3354d2a45\" (UID: \"d414c385-84d9-4599-a466-06d3354d2a45\") "
Jul 09 17:48:39.781038 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.781008    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-bundle" (OuterVolumeSpecName: "bundle") pod "d414c385-84d9-4599-a466-06d3354d2a45" (UID: "d414c385-84d9-4599-a466-06d3354d2a45"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:39.782519 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.782484    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d414c385-84d9-4599-a466-06d3354d2a45-kube-api-access-vgz54" (OuterVolumeSpecName: "kube-api-access-vgz54") pod "d414c385-84d9-4599-a466-06d3354d2a45" (UID: "d414c385-84d9-4599-a466-06d3354d2a45"). InnerVolumeSpecName "kube-api-access-vgz54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:39.785827 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.785787    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-util" (OuterVolumeSpecName: "util") pod "d414c385-84d9-4599-a466-06d3354d2a45" (UID: "d414c385-84d9-4599-a466-06d3354d2a45"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:39.881609 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.881488    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:39.881609 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.881550    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d414c385-84d9-4599-a466-06d3354d2a45-util\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:39.881609 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:39.881561    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgz54\" (UniqueName: \"kubernetes.io/projected/d414c385-84d9-4599-a466-06d3354d2a45-kube-api-access-vgz54\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:40.514784 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.514757    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b"
Jul 09 17:48:40.515160 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.514798    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead7672f2b" event={"ID":"d414c385-84d9-4599-a466-06d3354d2a45","Type":"ContainerDied","Data":"b53d20b8ad45139f75d3f89b3b76ed5bfc7844c46463a8f7aff080d31e54e8fe"}
Jul 09 17:48:40.515160 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.514849    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b53d20b8ad45139f75d3f89b3b76ed5bfc7844c46463a8f7aff080d31e54e8fe"
Jul 09 17:48:40.684674 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.684649    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:40.701810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.701783    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:40.705300 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.705272    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:40.788855 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.788755    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-util\") pod \"2375e997-4827-4c49-8776-76be9a73daad\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") "
Jul 09 17:48:40.788855 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.788838    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slfvp\" (UniqueName: \"kubernetes.io/projected/18bd71e7-55d1-4e1d-b103-e24cccb089c8-kube-api-access-slfvp\") pod \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") "
Jul 09 17:48:40.789088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.788929    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxg7w\" (UniqueName: \"kubernetes.io/projected/2375e997-4827-4c49-8776-76be9a73daad-kube-api-access-rxg7w\") pod \"2375e997-4827-4c49-8776-76be9a73daad\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") "
Jul 09 17:48:40.789088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.788991    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-bundle\") pod \"7fbd5472-8099-431d-8717-268d2a5ffabd\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") "
Jul 09 17:48:40.789088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-bundle\") pod \"2375e997-4827-4c49-8776-76be9a73daad\" (UID: \"2375e997-4827-4c49-8776-76be9a73daad\") "
Jul 09 17:48:40.789088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789070    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-util\") pod \"7fbd5472-8099-431d-8717-268d2a5ffabd\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") "
Jul 09 17:48:40.789299 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789122    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttw57\" (UniqueName: \"kubernetes.io/projected/7fbd5472-8099-431d-8717-268d2a5ffabd-kube-api-access-ttw57\") pod \"7fbd5472-8099-431d-8717-268d2a5ffabd\" (UID: \"7fbd5472-8099-431d-8717-268d2a5ffabd\") "
Jul 09 17:48:40.789299 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789194    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-bundle\") pod \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") "
Jul 09 17:48:40.789299 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789221    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-util\") pod \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\" (UID: \"18bd71e7-55d1-4e1d-b103-e24cccb089c8\") "
Jul 09 17:48:40.789623 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789511    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-bundle" (OuterVolumeSpecName: "bundle") pod "2375e997-4827-4c49-8776-76be9a73daad" (UID: "2375e997-4827-4c49-8776-76be9a73daad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:40.789623 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789574    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-bundle" (OuterVolumeSpecName: "bundle") pod "7fbd5472-8099-431d-8717-268d2a5ffabd" (UID: "7fbd5472-8099-431d-8717-268d2a5ffabd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:40.790008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.789983    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-bundle" (OuterVolumeSpecName: "bundle") pod "18bd71e7-55d1-4e1d-b103-e24cccb089c8" (UID: "18bd71e7-55d1-4e1d-b103-e24cccb089c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:40.791119 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.791094    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2375e997-4827-4c49-8776-76be9a73daad-kube-api-access-rxg7w" (OuterVolumeSpecName: "kube-api-access-rxg7w") pod "2375e997-4827-4c49-8776-76be9a73daad" (UID: "2375e997-4827-4c49-8776-76be9a73daad"). InnerVolumeSpecName "kube-api-access-rxg7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:40.791198 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.791131    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bd71e7-55d1-4e1d-b103-e24cccb089c8-kube-api-access-slfvp" (OuterVolumeSpecName: "kube-api-access-slfvp") pod "18bd71e7-55d1-4e1d-b103-e24cccb089c8" (UID: "18bd71e7-55d1-4e1d-b103-e24cccb089c8"). InnerVolumeSpecName "kube-api-access-slfvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:40.791198 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.791150    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fbd5472-8099-431d-8717-268d2a5ffabd-kube-api-access-ttw57" (OuterVolumeSpecName: "kube-api-access-ttw57") pod "7fbd5472-8099-431d-8717-268d2a5ffabd" (UID: "7fbd5472-8099-431d-8717-268d2a5ffabd"). InnerVolumeSpecName "kube-api-access-ttw57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:48:40.890880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.890846    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttw57\" (UniqueName: \"kubernetes.io/projected/7fbd5472-8099-431d-8717-268d2a5ffabd-kube-api-access-ttw57\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:40.890880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.890876    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:40.890880 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.890889    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slfvp\" (UniqueName: \"kubernetes.io/projected/18bd71e7-55d1-4e1d-b103-e24cccb089c8-kube-api-access-slfvp\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:40.891108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.890899    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxg7w\" (UniqueName: \"kubernetes.io/projected/2375e997-4827-4c49-8776-76be9a73daad-kube-api-access-rxg7w\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:40.891108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.890908    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:40.891108 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:40.890915    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-bundle\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:41.093519 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.093427    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-util" (OuterVolumeSpecName: "util") pod "18bd71e7-55d1-4e1d-b103-e24cccb089c8" (UID: "18bd71e7-55d1-4e1d-b103-e24cccb089c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:41.095645 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.095613    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-util" (OuterVolumeSpecName: "util") pod "2375e997-4827-4c49-8776-76be9a73daad" (UID: "2375e997-4827-4c49-8776-76be9a73daad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:41.097333 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.097309    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-util" (OuterVolumeSpecName: "util") pod "7fbd5472-8099-431d-8717-268d2a5ffabd" (UID: "7fbd5472-8099-431d-8717-268d2a5ffabd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:48:41.193521 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.193471    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bd71e7-55d1-4e1d-b103-e24cccb089c8-util\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:41.193521 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.193516    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2375e997-4827-4c49-8776-76be9a73daad-util\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:41.193521 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.193553    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbd5472-8099-431d-8717-268d2a5ffabd-util\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:48:41.521218 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.521182    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x"
Jul 09 17:48:41.521654 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.521217    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36j5w7x" event={"ID":"7fbd5472-8099-431d-8717-268d2a5ffabd","Type":"ContainerDied","Data":"a9abf267bb95a173de0e43893352aee0a3439c1a25cce5e1a2306feba292c0c8"}
Jul 09 17:48:41.521654 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.521270    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9abf267bb95a173de0e43893352aee0a3439c1a25cce5e1a2306feba292c0c8"
Jul 09 17:48:41.523126 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.523104    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76" event={"ID":"2375e997-4827-4c49-8776-76be9a73daad","Type":"ContainerDied","Data":"4b880cd135334c2cabbe330f795b746b11ceb3880cad993cd2e45f76441d414b"}
Jul 09 17:48:41.523276 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.523136    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317efzfk76"
Jul 09 17:48:41.523276 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.523146    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b880cd135334c2cabbe330f795b746b11ceb3880cad993cd2e45f76441d414b"
Jul 09 17:48:41.525008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.524984    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h" event={"ID":"18bd71e7-55d1-4e1d-b103-e24cccb089c8","Type":"ContainerDied","Data":"9ce4c92d82e25f9011a5d10db6fea7ec32af80a560346b4d37fd6c6a15e63972"}
Jul 09 17:48:41.525144 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.525020    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ce4c92d82e25f9011a5d10db6fea7ec32af80a560346b4d37fd6c6a15e63972"
Jul 09 17:48:41.525144 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:41.525040    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabmqd2h"
Jul 09 17:48:43.533983 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:43.533944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:44.334368 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:44.334340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:46.929699 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.929658    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-tsj82"]
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.929976    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2375e997-4827-4c49-8776-76be9a73daad" containerName="pull"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.929987    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2375e997-4827-4c49-8776-76be9a73daad" containerName="pull"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.929994    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerName="pull"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.929999    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerName="pull"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930006    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerName="extract"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930012    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerName="extract"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930022    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerName="util"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930027    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerName="util"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930035    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d414c385-84d9-4599-a466-06d3354d2a45" containerName="pull"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930040    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d414c385-84d9-4599-a466-06d3354d2a45" containerName="pull"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930046    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerName="extract"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930052    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerName="extract"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930061    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2375e997-4827-4c49-8776-76be9a73daad" containerName="extract"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930066    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2375e997-4827-4c49-8776-76be9a73daad" containerName="extract"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930074    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2375e997-4827-4c49-8776-76be9a73daad" containerName="util"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930079    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2375e997-4827-4c49-8776-76be9a73daad" containerName="util"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930085    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d414c385-84d9-4599-a466-06d3354d2a45" containerName="util"
Jul 09 17:48:46.930087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930090    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d414c385-84d9-4599-a466-06d3354d2a45" containerName="util"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930098    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerName="util"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930103    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerName="util"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930110    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerName="pull"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930115    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerName="pull"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930123    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d414c385-84d9-4599-a466-06d3354d2a45" containerName="extract"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930128    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d414c385-84d9-4599-a466-06d3354d2a45" containerName="extract"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930174    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bd71e7-55d1-4e1d-b103-e24cccb089c8" containerName="extract"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930180    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d414c385-84d9-4599-a466-06d3354d2a45" containerName="extract"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930187    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2375e997-4827-4c49-8776-76be9a73daad" containerName="extract"
Jul 09 17:48:46.930633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.930196    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fbd5472-8099-431d-8717-268d2a5ffabd" containerName="extract"
Jul 09 17:48:46.941575 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.941513    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-tsj82"
Jul 09 17:48:46.944438 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.944402    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 17:48:46.944968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.944933    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 17:48:46.945333 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.945312    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9zbql\""
Jul 09 17:48:46.947539 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:46.947507    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-tsj82"]
Jul 09 17:48:47.040187 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.040151    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxwcd\" (UniqueName: \"kubernetes.io/projected/00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff-kube-api-access-pxwcd\") pod \"authorino-operator-6d85f6564-tsj82\" (UID: \"00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff\") " pod="kuadrant-system/authorino-operator-6d85f6564-tsj82"
Jul 09 17:48:47.141600 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.141554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxwcd\" (UniqueName: \"kubernetes.io/projected/00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff-kube-api-access-pxwcd\") pod \"authorino-operator-6d85f6564-tsj82\" (UID: \"00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff\") " pod="kuadrant-system/authorino-operator-6d85f6564-tsj82"
Jul 09 17:48:47.155999 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.155955    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxwcd\" (UniqueName: \"kubernetes.io/projected/00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff-kube-api-access-pxwcd\") pod \"authorino-operator-6d85f6564-tsj82\" (UID: \"00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff\") " pod="kuadrant-system/authorino-operator-6d85f6564-tsj82"
Jul 09 17:48:47.253822 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.253724    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-tsj82"
Jul 09 17:48:47.402474 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.402425    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-tsj82"]
Jul 09 17:48:47.405034 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:47.405001    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fdfdeb_846a_4fc3_ab85_e6a6cfe556ff.slice/crio-84c2f88c6a5c9f59535fea629fb9e94ed289247317eacdd5a527a36648011657 WatchSource:0}: Error finding container 84c2f88c6a5c9f59535fea629fb9e94ed289247317eacdd5a527a36648011657: Status 404 returned error can't find the container with id 84c2f88c6a5c9f59535fea629fb9e94ed289247317eacdd5a527a36648011657
Jul 09 17:48:47.417424 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.417383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:47.509107 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.508988    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:47.556292 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.556257    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-tsj82" event={"ID":"00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff","Type":"ContainerStarted","Data":"84c2f88c6a5c9f59535fea629fb9e94ed289247317eacdd5a527a36648011657"}
Jul 09 17:48:47.753787 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:47.753743    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:48.156220 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:48.156165    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:48.561091 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:48.560958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:49.461370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:49.461332    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:49.561699 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:49.561664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:50.573807 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:50.573775    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-tsj82" event={"ID":"00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff","Type":"ContainerStarted","Data":"899dbb45db6fec7e3a2677a5e7998d04b3e221775b6c50cf68ad2b18f1caf94d"}
Jul 09 17:48:50.574179 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:50.573883    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-tsj82"
Jul 09 17:48:50.595641 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:50.595587    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-tsj82" podStartSLOduration=2.279691622 podStartE2EDuration="4.595568495s" totalImagesPullingTime="2.315876873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:48:50.593355784 +0000 UTC m=+584.638652294" watchObservedRunningTime="2026-07-09 17:48:50.595568495 +0000 UTC m=+584.640865005"
Jul 09 17:48:51.369401 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.369367    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"]
Jul 09 17:48:51.372633 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.372612    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.374947 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.374923    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8dftb\""
Jul 09 17:48:51.395483 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.395447    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"]
Jul 09 17:48:51.476798 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.476753    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8dd24b-adb8-4c7e-8019-263ed2e14fac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-z679n\" (UID: \"da8dd24b-adb8-4c7e-8019-263ed2e14fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.476983 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.476844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjgzl\" (UniqueName: \"kubernetes.io/projected/da8dd24b-adb8-4c7e-8019-263ed2e14fac-kube-api-access-sjgzl\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-z679n\" (UID: \"da8dd24b-adb8-4c7e-8019-263ed2e14fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.577420 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.577386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8dd24b-adb8-4c7e-8019-263ed2e14fac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-z679n\" (UID: \"da8dd24b-adb8-4c7e-8019-263ed2e14fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.577862 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.577467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgzl\" (UniqueName: \"kubernetes.io/projected/da8dd24b-adb8-4c7e-8019-263ed2e14fac-kube-api-access-sjgzl\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-z679n\" (UID: \"da8dd24b-adb8-4c7e-8019-263ed2e14fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.577862 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.577798    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8dd24b-adb8-4c7e-8019-263ed2e14fac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-z679n\" (UID: \"da8dd24b-adb8-4c7e-8019-263ed2e14fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.587464 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.587432    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjgzl\" (UniqueName: \"kubernetes.io/projected/da8dd24b-adb8-4c7e-8019-263ed2e14fac-kube-api-access-sjgzl\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-z679n\" (UID: \"da8dd24b-adb8-4c7e-8019-263ed2e14fac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.683225 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.683184    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:51.838494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.838464    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"]
Jul 09 17:48:51.841394 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:51.841355    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8dd24b_adb8_4c7e_8019_263ed2e14fac.slice/crio-54298a8a3e1f3f8a80c7b8295dab6dfa554bbea51efd580658d4678c0a52540a WatchSource:0}: Error finding container 54298a8a3e1f3f8a80c7b8295dab6dfa554bbea51efd580658d4678c0a52540a: Status 404 returned error can't find the container with id 54298a8a3e1f3f8a80c7b8295dab6dfa554bbea51efd580658d4678c0a52540a
Jul 09 17:48:51.974659 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:51.974571    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:52.215309 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:52.215274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:52.584976 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:52.584934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n" event={"ID":"da8dd24b-adb8-4c7e-8019-263ed2e14fac","Type":"ContainerStarted","Data":"54298a8a3e1f3f8a80c7b8295dab6dfa554bbea51efd580658d4678c0a52540a"}
Jul 09 17:48:54.177002 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:54.176968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:54.844248 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:54.844216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:55.949116 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:55.949069    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"]
Jul 09 17:48:55.952996 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:55.952969    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"
Jul 09 17:48:55.956271 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:55.956248    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dgt8b\""
Jul 09 17:48:55.956447 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:55.956425    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 17:48:55.967134 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:55.967103    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"]
Jul 09 17:48:56.013796 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.013757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhvk2\" (UniqueName: \"kubernetes.io/projected/3c47993e-2e31-4c2c-99db-6d6875a95edc-kube-api-access-mhvk2\") pod \"dns-operator-controller-manager-65b49595d7-rc99j\" (UID: \"3c47993e-2e31-4c2c-99db-6d6875a95edc\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"
Jul 09 17:48:56.114881 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.114839    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhvk2\" (UniqueName: \"kubernetes.io/projected/3c47993e-2e31-4c2c-99db-6d6875a95edc-kube-api-access-mhvk2\") pod \"dns-operator-controller-manager-65b49595d7-rc99j\" (UID: \"3c47993e-2e31-4c2c-99db-6d6875a95edc\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"
Jul 09 17:48:56.124249 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.124212    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhvk2\" (UniqueName: \"kubernetes.io/projected/3c47993e-2e31-4c2c-99db-6d6875a95edc-kube-api-access-mhvk2\") pod \"dns-operator-controller-manager-65b49595d7-rc99j\" (UID: \"3c47993e-2e31-4c2c-99db-6d6875a95edc\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"
Jul 09 17:48:56.267198 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.267162    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"
Jul 09 17:48:56.418443 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.418415    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"]
Jul 09 17:48:56.420050 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:48:56.420014    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c47993e_2e31_4c2c_99db_6d6875a95edc.slice/crio-996edef6ccea5d6ddb1730fae5335265fe28437980c9e9b9df2f8cea7496dbc4 WatchSource:0}: Error finding container 996edef6ccea5d6ddb1730fae5335265fe28437980c9e9b9df2f8cea7496dbc4: Status 404 returned error can't find the container with id 996edef6ccea5d6ddb1730fae5335265fe28437980c9e9b9df2f8cea7496dbc4
Jul 09 17:48:56.613871 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.613778    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j" event={"ID":"3c47993e-2e31-4c2c-99db-6d6875a95edc","Type":"ContainerStarted","Data":"996edef6ccea5d6ddb1730fae5335265fe28437980c9e9b9df2f8cea7496dbc4"}
Jul 09 17:48:56.615367 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.615343    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n" event={"ID":"da8dd24b-adb8-4c7e-8019-263ed2e14fac","Type":"ContainerStarted","Data":"dbe46f1987eef4897e9479b30bc4160a3ef9f81d02c1d7f26081cf0b916b5f2d"}
Jul 09 17:48:56.615488 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.615474    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:48:56.635260 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:56.635206    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n" podStartSLOduration=1.333833275 podStartE2EDuration="5.635189498s" totalImagesPullingTime="4.301356223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:48:56.635022342 +0000 UTC m=+590.680318854" watchObservedRunningTime="2026-07-09 17:48:56.635189498 +0000 UTC m=+590.680486008"
Jul 09 17:48:57.171843 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:57.171812    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:57.279493 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:57.274286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:57.597755 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:57.597628    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:57.680756 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:57.680717    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:58.732364 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.732287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:58.745209 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.745132    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"]
Jul 09 17:48:58.749159 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.749133    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.753851 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.753819    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6l6kt\""
Jul 09 17:48:58.754864 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.754795    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 17:48:58.755205 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.755188    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 17:48:58.760799 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.760730    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"]
Jul 09 17:48:58.836661 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.836617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d63914-3e7a-4b0e-b976-6d9646634f7e-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.836861 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.836701    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0d63914-3e7a-4b0e-b976-6d9646634f7e-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.836861 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.836734    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxrw9\" (UniqueName: \"kubernetes.io/projected/c0d63914-3e7a-4b0e-b976-6d9646634f7e-kube-api-access-lxrw9\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.937733 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.937230    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d63914-3e7a-4b0e-b976-6d9646634f7e-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.937733 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.937312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0d63914-3e7a-4b0e-b976-6d9646634f7e-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.937733 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.937348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxrw9\" (UniqueName: \"kubernetes.io/projected/c0d63914-3e7a-4b0e-b976-6d9646634f7e-kube-api-access-lxrw9\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.937733 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:48:58.937630    2569 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 17:48:58.937733 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:48:58.937709    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d63914-3e7a-4b0e-b976-6d9646634f7e-plugin-serving-cert podName:c0d63914-3e7a-4b0e-b976-6d9646634f7e nodeName:}" failed. No retries permitted until 2026-07-09 17:48:59.437688786 +0000 UTC m=+593.482985280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c0d63914-3e7a-4b0e-b976-6d9646634f7e-plugin-serving-cert") pod "kuadrant-console-plugin-85fd4b8b9d-rqdm2" (UID: "c0d63914-3e7a-4b0e-b976-6d9646634f7e") : secret "plugin-serving-cert" not found
Jul 09 17:48:58.938295 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.938271    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0d63914-3e7a-4b0e-b976-6d9646634f7e-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:58.949281 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:58.949247    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxrw9\" (UniqueName: \"kubernetes.io/projected/c0d63914-3e7a-4b0e-b976-6d9646634f7e-kube-api-access-lxrw9\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:59.304405 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:59.304362    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:48:59.441214 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:59.441175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d63914-3e7a-4b0e-b976-6d9646634f7e-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:59.443956 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:59.443932    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d63914-3e7a-4b0e-b976-6d9646634f7e-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-rqdm2\" (UID: \"c0d63914-3e7a-4b0e-b976-6d9646634f7e\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:48:59.672597 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:48:59.672561    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"
Jul 09 17:49:00.425481 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:00.425454    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2"]
Jul 09 17:49:00.428119 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:49:00.428092    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0d63914_3e7a_4b0e_b976_6d9646634f7e.slice/crio-cce81ad7b10218880ed6d43ec90904a923ff8d285a30cd3a3be6aaf832b65c64 WatchSource:0}: Error finding container cce81ad7b10218880ed6d43ec90904a923ff8d285a30cd3a3be6aaf832b65c64: Status 404 returned error can't find the container with id cce81ad7b10218880ed6d43ec90904a923ff8d285a30cd3a3be6aaf832b65c64
Jul 09 17:49:00.640754 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:00.640700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j" event={"ID":"3c47993e-2e31-4c2c-99db-6d6875a95edc","Type":"ContainerStarted","Data":"789ef94a76da25af81356a974c8d62bfd19f2854719340d88f2089e6c9d00a1c"}
Jul 09 17:49:00.640959 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:00.640878    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"
Jul 09 17:49:00.642035 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:00.642012    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2" event={"ID":"c0d63914-3e7a-4b0e-b976-6d9646634f7e","Type":"ContainerStarted","Data":"cce81ad7b10218880ed6d43ec90904a923ff8d285a30cd3a3be6aaf832b65c64"}
Jul 09 17:49:00.674020 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:00.673961    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j" podStartSLOduration=1.740858255 podStartE2EDuration="5.673942903s" totalImagesPullingTime="3.933084648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:49:00.671378448 +0000 UTC m=+594.716674958" watchObservedRunningTime="2026-07-09 17:49:00.673942903 +0000 UTC m=+594.719239413"
Jul 09 17:49:01.581989 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:01.581957    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-tsj82"
Jul 09 17:49:02.774796 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:02.774755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:02.873010 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:02.872978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:03.359180 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:03.359142    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:03.435218 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:03.435180    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:03.747234 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:03.747200    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:03.825073 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:03.825031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:05.677164 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:05.677126    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2" event={"ID":"c0d63914-3e7a-4b0e-b976-6d9646634f7e","Type":"ContainerStarted","Data":"c533d097f8aa1f4c58209602a9cf386e89a34fc76e800278deb1b5ae73c93f01"}
Jul 09 17:49:05.693637 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:05.693584    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2" podStartSLOduration=2.912908861 podStartE2EDuration="7.693568224s" totalImagesPullingTime="4.780659363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:49:05.692743222 +0000 UTC m=+599.738039734" watchObservedRunningTime="2026-07-09 17:49:05.693568224 +0000 UTC m=+599.738864735"
Jul 09 17:49:06.418088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:06.418058    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:49:06.418088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:06.418063    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:49:06.423129 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:06.423102    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:49:06.423390 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:06.423326    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:49:07.623958 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:07.623926    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n"
Jul 09 17:49:10.203856 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:10.203823    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:10.303801 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:10.303768    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:11.656085 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:11.656056    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j"
Jul 09 17:49:12.616913 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:12.616878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:12.712036 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:12.711996    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:17.296832 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:17.296797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:17.411018 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:17.410989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:22.815010 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:22.814970    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:22.917014 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:22.916982    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:23.170177 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:23.170140    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:23.250094 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:23.250058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:23.567717 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:23.567629    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:23.683039 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:23.683003    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:27.668471 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:27.668432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:27.767860 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:27.767823    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:31.208520 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:31.208435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:31.304159 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:31.304123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:34.530971 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:34.530939    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:34.636926 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:34.636894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:35.372107 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:35.372072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:35.471467 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:35.471426    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:39.367814 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:39.367777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:39.435878 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:39.435845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:43.571733 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:43.571696    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:43.693308 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:43.693271    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:43.795219 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:43.795173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:44.502441 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.502406    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b6c89bb85-d9kpg"]
Jul 09 17:49:44.525425 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.525392    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-d9kpg"]
Jul 09 17:49:44.525616 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.525506    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-d9kpg"
Jul 09 17:49:44.528988 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.528956    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kxx5n\""
Jul 09 17:49:44.536212 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.536166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:44.636358 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.636314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:49:44.639601 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.639572    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwdl5\" (UniqueName: \"kubernetes.io/projected/fe3ab8d4-67bb-418e-900d-577c71e11438-kube-api-access-qwdl5\") pod \"authorino-b6c89bb85-d9kpg\" (UID: \"fe3ab8d4-67bb-418e-900d-577c71e11438\") " pod="kuadrant-system/authorino-b6c89bb85-d9kpg"
Jul 09 17:49:44.741109 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.741068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwdl5\" (UniqueName: \"kubernetes.io/projected/fe3ab8d4-67bb-418e-900d-577c71e11438-kube-api-access-qwdl5\") pod \"authorino-b6c89bb85-d9kpg\" (UID: \"fe3ab8d4-67bb-418e-900d-577c71e11438\") " pod="kuadrant-system/authorino-b6c89bb85-d9kpg"
Jul 09 17:49:44.751399 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.751365    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwdl5\" (UniqueName: \"kubernetes.io/projected/fe3ab8d4-67bb-418e-900d-577c71e11438-kube-api-access-qwdl5\") pod \"authorino-b6c89bb85-d9kpg\" (UID: \"fe3ab8d4-67bb-418e-900d-577c71e11438\") " pod="kuadrant-system/authorino-b6c89bb85-d9kpg"
Jul 09 17:49:44.835746 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:44.835655    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-d9kpg"
Jul 09 17:49:45.006480 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:45.006451    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-d9kpg"]
Jul 09 17:49:45.009230 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:49:45.009200    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe3ab8d4_67bb_418e_900d_577c71e11438.slice/crio-1633a89fbbba69854c0235230f5c919c07cf618f2d94b2d1783d323d25f17934 WatchSource:0}: Error finding container 1633a89fbbba69854c0235230f5c919c07cf618f2d94b2d1783d323d25f17934: Status 404 returned error can't find the container with id 1633a89fbbba69854c0235230f5c919c07cf618f2d94b2d1783d323d25f17934
Jul 09 17:49:45.894129 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:45.894088    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-d9kpg" event={"ID":"fe3ab8d4-67bb-418e-900d-577c71e11438","Type":"ContainerStarted","Data":"1633a89fbbba69854c0235230f5c919c07cf618f2d94b2d1783d323d25f17934"}
Jul 09 17:49:47.907314 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:47.907276    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-d9kpg" event={"ID":"fe3ab8d4-67bb-418e-900d-577c71e11438","Type":"ContainerStarted","Data":"5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60"}
Jul 09 17:49:47.929089 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:47.929022    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b6c89bb85-d9kpg" podStartSLOduration=1.421890491 podStartE2EDuration="3.929005194s" totalImagesPullingTime="2.507114703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:49:47.928000871 +0000 UTC m=+641.973297382" watchObservedRunningTime="2026-07-09 17:49:47.929005194 +0000 UTC m=+641.974301705"
Jul 09 17:49:50.617616 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.617574    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-d9kpg"]
Jul 09 17:49:50.618152 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.617750    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b6c89bb85-d9kpg" podUID="fe3ab8d4-67bb-418e-900d-577c71e11438" containerName="authorino" containerID="cri-o://5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60" gracePeriod=30
Jul 09 17:49:50.870119 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.870047    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-d9kpg"
Jul 09 17:49:50.899109 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.899074    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwdl5\" (UniqueName: \"kubernetes.io/projected/fe3ab8d4-67bb-418e-900d-577c71e11438-kube-api-access-qwdl5\") pod \"fe3ab8d4-67bb-418e-900d-577c71e11438\" (UID: \"fe3ab8d4-67bb-418e-900d-577c71e11438\") "
Jul 09 17:49:50.901277 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.901246    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3ab8d4-67bb-418e-900d-577c71e11438-kube-api-access-qwdl5" (OuterVolumeSpecName: "kube-api-access-qwdl5") pod "fe3ab8d4-67bb-418e-900d-577c71e11438" (UID: "fe3ab8d4-67bb-418e-900d-577c71e11438"). InnerVolumeSpecName "kube-api-access-qwdl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:49:50.927933 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.927897    2569 generic.go:356] "Generic (PLEG): container finished" podID="fe3ab8d4-67bb-418e-900d-577c71e11438" containerID="5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60" exitCode=0
Jul 09 17:49:50.928118 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.927942    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-d9kpg" event={"ID":"fe3ab8d4-67bb-418e-900d-577c71e11438","Type":"ContainerDied","Data":"5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60"}
Jul 09 17:49:50.928118 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.927990    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-d9kpg" event={"ID":"fe3ab8d4-67bb-418e-900d-577c71e11438","Type":"ContainerDied","Data":"1633a89fbbba69854c0235230f5c919c07cf618f2d94b2d1783d323d25f17934"}
Jul 09 17:49:50.928118 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.928007    2569 scope.go:117] "RemoveContainer" containerID="5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60"
Jul 09 17:49:50.928118 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.927950    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-d9kpg"
Jul 09 17:49:50.938065 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.938044    2569 scope.go:117] "RemoveContainer" containerID="5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60"
Jul 09 17:49:50.938398 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:49:50.938377    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60\": container with ID starting with 5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60 not found: ID does not exist" containerID="5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60"
Jul 09 17:49:50.938451 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.938408    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60"} err="failed to get container status \"5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60\": rpc error: code = NotFound desc = could not find container \"5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60\": container with ID starting with 5731c48db62379171e87f06180724fb711c1adac396927ed07772301f504fa60 not found: ID does not exist"
Jul 09 17:49:50.950785 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.950745    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-d9kpg"]
Jul 09 17:49:50.953228 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.953195    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-d9kpg"]
Jul 09 17:49:50.999866 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:50.999830    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwdl5\" (UniqueName: \"kubernetes.io/projected/fe3ab8d4-67bb-418e-900d-577c71e11438-kube-api-access-qwdl5\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:49:52.500810 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:49:52.500771    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe3ab8d4-67bb-418e-900d-577c71e11438" path="/var/lib/kubelet/pods/fe3ab8d4-67bb-418e-900d-577c71e11438/volumes"
Jul 09 17:50:06.703195 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:06.703092    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:50:09.127647 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:09.127613    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:50:11.298598 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.298547    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c77957575-czzst"]
Jul 09 17:50:11.299170 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.299146    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3ab8d4-67bb-418e-900d-577c71e11438" containerName="authorino"
Jul 09 17:50:11.299255 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.299173    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3ab8d4-67bb-418e-900d-577c71e11438" containerName="authorino"
Jul 09 17:50:11.299323 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.299310    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe3ab8d4-67bb-418e-900d-577c71e11438" containerName="authorino"
Jul 09 17:50:11.303889 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.303860    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.306502 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.306476    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 17:50:11.306783 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.306764    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kxx5n\""
Jul 09 17:50:11.312737 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.312710    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-czzst"]
Jul 09 17:50:11.372929 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.372890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5jv\" (UniqueName: \"kubernetes.io/projected/fdfd4f33-5ba4-46fe-8713-553140c2a405-kube-api-access-gj5jv\") pod \"authorino-7c77957575-czzst\" (UID: \"fdfd4f33-5ba4-46fe-8713-553140c2a405\") " pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.373112 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.373018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdfd4f33-5ba4-46fe-8713-553140c2a405-tls-cert\") pod \"authorino-7c77957575-czzst\" (UID: \"fdfd4f33-5ba4-46fe-8713-553140c2a405\") " pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.473995 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.473959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdfd4f33-5ba4-46fe-8713-553140c2a405-tls-cert\") pod \"authorino-7c77957575-czzst\" (UID: \"fdfd4f33-5ba4-46fe-8713-553140c2a405\") " pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.474191 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.474005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5jv\" (UniqueName: \"kubernetes.io/projected/fdfd4f33-5ba4-46fe-8713-553140c2a405-kube-api-access-gj5jv\") pod \"authorino-7c77957575-czzst\" (UID: \"fdfd4f33-5ba4-46fe-8713-553140c2a405\") " pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.476615 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.476592    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdfd4f33-5ba4-46fe-8713-553140c2a405-tls-cert\") pod \"authorino-7c77957575-czzst\" (UID: \"fdfd4f33-5ba4-46fe-8713-553140c2a405\") " pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.483463 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.483435    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5jv\" (UniqueName: \"kubernetes.io/projected/fdfd4f33-5ba4-46fe-8713-553140c2a405-kube-api-access-gj5jv\") pod \"authorino-7c77957575-czzst\" (UID: \"fdfd4f33-5ba4-46fe-8713-553140c2a405\") " pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.614702 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.614604    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-czzst"
Jul 09 17:50:11.759965 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.759932    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-czzst"]
Jul 09 17:50:11.762264 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:50:11.762238    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdfd4f33_5ba4_46fe_8713_553140c2a405.slice/crio-2a4c7484f79e39beb38760456e23bc1a57bd9a4a7ba0277d20684cc68304ee4c WatchSource:0}: Error finding container 2a4c7484f79e39beb38760456e23bc1a57bd9a4a7ba0277d20684cc68304ee4c: Status 404 returned error can't find the container with id 2a4c7484f79e39beb38760456e23bc1a57bd9a4a7ba0277d20684cc68304ee4c
Jul 09 17:50:11.763937 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:11.763919    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:50:12.045387 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:12.045346    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-czzst" event={"ID":"fdfd4f33-5ba4-46fe-8713-553140c2a405","Type":"ContainerStarted","Data":"2a4c7484f79e39beb38760456e23bc1a57bd9a4a7ba0277d20684cc68304ee4c"}
Jul 09 17:50:13.052490 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:13.052452    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-czzst" event={"ID":"fdfd4f33-5ba4-46fe-8713-553140c2a405","Type":"ContainerStarted","Data":"d87d0da27c41a70de9f0e2a36aa9c6244814ad01c3ef9ad26954c51a3edc33b4"}
Jul 09 17:50:13.070702 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:13.070636    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c77957575-czzst" podStartSLOduration=1.571984386 podStartE2EDuration="2.070617925s" totalImagesPullingTime="498.633539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:50:13.069067963 +0000 UTC m=+667.114364465" watchObservedRunningTime="2026-07-09 17:50:13.070617925 +0000 UTC m=+667.115914481"
Jul 09 17:50:17.175938 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.175888    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-wmkwl"]
Jul 09 17:50:17.176407 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.176126    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl" podUID="eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" containerName="manager" containerID="cri-o://2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7" gracePeriod=10
Jul 09 17:50:17.230037 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.229997    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-7b946"]
Jul 09 17:50:17.233470 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.233449    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.249545 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.249487    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-7b946"]
Jul 09 17:50:17.328520 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.328475    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d-cert\") pod \"kserve-controller-manager-6b8548bc6d-7b946\" (UID: \"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d\") " pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.328703 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.328576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cr7x\" (UniqueName: \"kubernetes.io/projected/d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d-kube-api-access-9cr7x\") pod \"kserve-controller-manager-6b8548bc6d-7b946\" (UID: \"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d\") " pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.429940 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.429844    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d-cert\") pod \"kserve-controller-manager-6b8548bc6d-7b946\" (UID: \"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d\") " pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.430090 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.429957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cr7x\" (UniqueName: \"kubernetes.io/projected/d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d-kube-api-access-9cr7x\") pod \"kserve-controller-manager-6b8548bc6d-7b946\" (UID: \"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d\") " pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.432492 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.432465    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d-cert\") pod \"kserve-controller-manager-6b8548bc6d-7b946\" (UID: \"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d\") " pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.439966 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.439935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cr7x\" (UniqueName: \"kubernetes.io/projected/d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d-kube-api-access-9cr7x\") pod \"kserve-controller-manager-6b8548bc6d-7b946\" (UID: \"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d\") " pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.453728 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.453699    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:50:17.530636 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.530596    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert\") pod \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") "
Jul 09 17:50:17.530815 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.530725    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7svcr\" (UniqueName: \"kubernetes.io/projected/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-kube-api-access-7svcr\") pod \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\" (UID: \"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7\") "
Jul 09 17:50:17.532921 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.532884    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert" (OuterVolumeSpecName: "cert") pod "eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" (UID: "eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:50:17.532921 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.532907    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-kube-api-access-7svcr" (OuterVolumeSpecName: "kube-api-access-7svcr") pod "eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" (UID: "eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7"). InnerVolumeSpecName "kube-api-access-7svcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:50:17.562317 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.562273    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:17.631836 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.631798    2569 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:50:17.631836 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.631832    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7svcr\" (UniqueName: \"kubernetes.io/projected/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7-kube-api-access-7svcr\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:50:17.709138 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:17.709111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-7b946"]
Jul 09 17:50:17.711109 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:50:17.711082    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e0e2a0_9d99_4c3e_9638_885b1ee62a2d.slice/crio-2d4c974022c42d2ae0976ae86f4e7cc8d7a4d4b237e37d8bc4a4ca2b2aefba15 WatchSource:0}: Error finding container 2d4c974022c42d2ae0976ae86f4e7cc8d7a4d4b237e37d8bc4a4ca2b2aefba15: Status 404 returned error can't find the container with id 2d4c974022c42d2ae0976ae86f4e7cc8d7a4d4b237e37d8bc4a4ca2b2aefba15
Jul 09 17:50:18.079269 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.079178    2569 generic.go:356] "Generic (PLEG): container finished" podID="eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" containerID="2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7" exitCode=0
Jul 09 17:50:18.079269 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.079223    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl"
Jul 09 17:50:18.079468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.079269    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl" event={"ID":"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7","Type":"ContainerDied","Data":"2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7"}
Jul 09 17:50:18.079468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.079323    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-wmkwl" event={"ID":"eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7","Type":"ContainerDied","Data":"51233d76326e8126f3dd426b6ff90dc0a32762de96b6d6cdf32022b107992bff"}
Jul 09 17:50:18.079468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.079354    2569 scope.go:117] "RemoveContainer" containerID="2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7"
Jul 09 17:50:18.080686 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.080662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-7b946" event={"ID":"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d","Type":"ContainerStarted","Data":"2d4c974022c42d2ae0976ae86f4e7cc8d7a4d4b237e37d8bc4a4ca2b2aefba15"}
Jul 09 17:50:18.088509 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.088486    2569 scope.go:117] "RemoveContainer" containerID="2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7"
Jul 09 17:50:18.088951 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:50:18.088929    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7\": container with ID starting with 2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7 not found: ID does not exist" containerID="2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7"
Jul 09 17:50:18.089011 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.088963    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7"} err="failed to get container status \"2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7\": rpc error: code = NotFound desc = could not find container \"2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7\": container with ID starting with 2bee7ba5212bc44cf63ee522e0aebea2eaac958b4180b912fbde8d103c4a74a7 not found: ID does not exist"
Jul 09 17:50:18.102764 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.102726    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-wmkwl"]
Jul 09 17:50:18.104814 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.104786    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-6b8548bc6d-wmkwl"]
Jul 09 17:50:18.500468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:18.500420    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" path="/var/lib/kubelet/pods/eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7/volumes"
Jul 09 17:50:19.087128 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:19.087085    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b8548bc6d-7b946" event={"ID":"d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d","Type":"ContainerStarted","Data":"ff9e436c91b66cfbfc223d6e63e9e8e13dca6e4b78c81224a2fa5853f0658eb3"}
Jul 09 17:50:19.087341 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:19.087154    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:19.105849 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:19.105792    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6b8548bc6d-7b946" podStartSLOduration=1.638344149 podStartE2EDuration="2.105773961s" totalImagesPullingTime="467.429812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:50:19.104845033 +0000 UTC m=+673.150141543" watchObservedRunningTime="2026-07-09 17:50:19.105773961 +0000 UTC m=+673.151070472"
Jul 09 17:50:50.099483 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:50.099450    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6b8548bc6d-7b946"
Jul 09 17:50:51.132515 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:51.132480    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:50:51.238471 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:51.238440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:50:51.410199 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:51.410107    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:50:51.675219 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:51.675132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:50:52.020346 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:52.020247    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:50:52.082741 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:50:52.082707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:51:08.831042 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:51:08.831000    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:51:21.380331 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:51:21.380294    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:18.612924 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:18.612891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:18.697586 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:18.697547    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:25.597177 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:25.597135    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:25.696219 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:25.696185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:38.727700 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:38.727667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:38.820300 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:38.820258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:42.454984 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:42.454950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:43.276319 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.276283    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"]
Jul 09 17:52:43.276695 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.276682    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" containerName="manager"
Jul 09 17:52:43.276753 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.276697    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" containerName="manager"
Jul 09 17:52:43.276803 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.276768    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff0a1ff-9dbd-4602-8e33-1f81f0c6e8a7" containerName="manager"
Jul 09 17:52:43.279825 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.279799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.283036 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.282989    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 17:52:43.283198 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.283085    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 17:52:43.283198 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.282990    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs\""
Jul 09 17:52:43.286970 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.286942    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 17:52:43.294728 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.294691    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"]
Jul 09 17:52:43.330681 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.330645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:43.333817 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.333793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.333941 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.333830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.333941 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.333858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.334027 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.333965    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.334027 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.334007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26lbg\" (UniqueName: \"kubernetes.io/projected/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-kube-api-access-26lbg\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.334092 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.334053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.434854 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.434817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.434854 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.434853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.435093 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.434979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.435093 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.435012    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26lbg\" (UniqueName: \"kubernetes.io/projected/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-kube-api-access-26lbg\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.435093 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.435050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.435261 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.435173    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.435319 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.435293    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.435454 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.435424    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.435602 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.435435    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.437327 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.437304    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.437534 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.437504    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.443632 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.443603    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26lbg\" (UniqueName: \"kubernetes.io/projected/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-kube-api-access-26lbg\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.591785 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.591685    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:43.763446 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.763416    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"]
Jul 09 17:52:43.766014 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:52:43.765949    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762188fe_e7e1_41f7_8ebd_d6b0645ce5db.slice/crio-8fbab025a38c7f1d3ce86da02b5addddc1db850c5a9e003ebddbf7666f81af22 WatchSource:0}: Error finding container 8fbab025a38c7f1d3ce86da02b5addddc1db850c5a9e003ebddbf7666f81af22: Status 404 returned error can't find the container with id 8fbab025a38c7f1d3ce86da02b5addddc1db850c5a9e003ebddbf7666f81af22
Jul 09 17:52:43.868370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:43.868262    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5" event={"ID":"762188fe-e7e1-41f7-8ebd-d6b0645ce5db","Type":"ContainerStarted","Data":"8fbab025a38c7f1d3ce86da02b5addddc1db850c5a9e003ebddbf7666f81af22"}
Jul 09 17:52:45.882194 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:45.882152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5" event={"ID":"762188fe-e7e1-41f7-8ebd-d6b0645ce5db","Type":"ContainerStarted","Data":"3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee"}
Jul 09 17:52:45.919209 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:45.919148    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5" podStartSLOduration=1.583231627 podStartE2EDuration="2.919127834s" totalImagesPullingTime="1.335896207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:52:45.918815533 +0000 UTC m=+819.964112045" watchObservedRunningTime="2026-07-09 17:52:45.919127834 +0000 UTC m=+819.964424344"
Jul 09 17:52:46.592040 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:46.592006    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:53.592886 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:53.592844    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:53.606476 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:53.606446    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:52:53.938168 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:52:53.938134    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:53:11.361046 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:11.361008    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:11.727614 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:11.727580    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:14.416936 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:14.416898    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"]
Jul 09 17:53:14.443330 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:14.443296    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:20.217311 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:20.217274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:23.011788 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.011752    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"]
Jul 09 17:53:23.015648 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.015625    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.018024 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.018001    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-lk5vb\""
Jul 09 17:53:23.018155 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.018006    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 17:53:23.028427 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.028398    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"]
Jul 09 17:53:23.093730 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.093944 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093753    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqptf\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-kube-api-access-zqptf\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.093944 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.093944 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093812    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7234ec8e-0a77-48ac-b13b-ca834d41950b-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.093944 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.093944 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.094185 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093945    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.094185 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.093975    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.094185 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.094053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194748 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194703    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194748 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194752    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqptf\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-kube-api-access-zqptf\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7234ec8e-0a77-48ac-b13b-ca834d41950b-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194935    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.194968 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.194962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.195272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.195128    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.195333 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.195272    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.195390 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.195333    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.195452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.195422    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.195452 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.195425    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.195648 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.195630    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7234ec8e-0a77-48ac-b13b-ca834d41950b-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.197313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.197292    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.197571 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.197551    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.204189 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.204161    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.204308 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.204242    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqptf\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-kube-api-access-zqptf\") pod \"router-gateway-1-openshift-default-54c47cdfc7-s6w2m\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.326449 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.326350    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:23.477265 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:23.477232    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"]
Jul 09 17:53:23.479324 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:53:23.479287    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7234ec8e_0a77_48ac_b13b_ca834d41950b.slice/crio-e4532693f062140157b6281671e20774431d46a39c5c63067f9fc6d64d8624f7 WatchSource:0}: Error finding container e4532693f062140157b6281671e20774431d46a39c5c63067f9fc6d64d8624f7: Status 404 returned error can't find the container with id e4532693f062140157b6281671e20774431d46a39c5c63067f9fc6d64d8624f7
Jul 09 17:53:24.096374 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:24.096319    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" event={"ID":"7234ec8e-0a77-48ac-b13b-ca834d41950b","Type":"ContainerStarted","Data":"e4532693f062140157b6281671e20774431d46a39c5c63067f9fc6d64d8624f7"}
Jul 09 17:53:25.988254 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:25.988218    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 17:53:25.988639 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:25.988299    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 17:53:25.988639 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:25.988328    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 17:53:26.108965 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:26.108917    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" event={"ID":"7234ec8e-0a77-48ac-b13b-ca834d41950b","Type":"ContainerStarted","Data":"bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320"}
Jul 09 17:53:26.136087 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:26.136024    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podStartSLOduration=1.629610954 podStartE2EDuration="4.136006297s" totalImagesPullingTime="2.506395343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:53:26.133321603 +0000 UTC m=+860.178618116" watchObservedRunningTime="2026-07-09 17:53:26.136006297 +0000 UTC m=+860.181302870"
Jul 09 17:53:26.327327 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:26.327233    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:27.332329 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:27.332287    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:28.121069 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:28.121037    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:28.122183 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:28.122163    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 17:53:29.438600 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.438558    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5" podUID="762188fe-e7e1-41f7-8ebd-d6b0645ce5db" containerName="main" containerID="cri-o://3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee" gracePeriod=45
Jul 09 17:53:29.708784 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.708751    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:53:29.754686 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.754644    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tls-certs\") pod \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") "
Jul 09 17:53:29.754899 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.754715    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-model-cache\") pod \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") "
Jul 09 17:53:29.754899 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.754789    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tmp-dir\") pod \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") "
Jul 09 17:53:29.754899 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.754835    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-dshm\") pod \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") "
Jul 09 17:53:29.754899 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.754893    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-home\") pod \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") "
Jul 09 17:53:29.755132 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.754947    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26lbg\" (UniqueName: \"kubernetes.io/projected/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-kube-api-access-26lbg\") pod \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\" (UID: \"762188fe-e7e1-41f7-8ebd-d6b0645ce5db\") "
Jul 09 17:53:29.755132 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.754943    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-model-cache" (OuterVolumeSpecName: "model-cache") pod "762188fe-e7e1-41f7-8ebd-d6b0645ce5db" (UID: "762188fe-e7e1-41f7-8ebd-d6b0645ce5db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:53:29.755132 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.755018    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "762188fe-e7e1-41f7-8ebd-d6b0645ce5db" (UID: "762188fe-e7e1-41f7-8ebd-d6b0645ce5db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:53:29.755313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.755140    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-home" (OuterVolumeSpecName: "home") pod "762188fe-e7e1-41f7-8ebd-d6b0645ce5db" (UID: "762188fe-e7e1-41f7-8ebd-d6b0645ce5db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:53:29.755313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.755252    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-home\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:53:29.755313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.755271    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-model-cache\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:53:29.755313 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.755286    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tmp-dir\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:53:29.757291 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.757253    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-kube-api-access-26lbg" (OuterVolumeSpecName: "kube-api-access-26lbg") pod "762188fe-e7e1-41f7-8ebd-d6b0645ce5db" (UID: "762188fe-e7e1-41f7-8ebd-d6b0645ce5db"). InnerVolumeSpecName "kube-api-access-26lbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:53:29.757291 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.757258    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-dshm" (OuterVolumeSpecName: "dshm") pod "762188fe-e7e1-41f7-8ebd-d6b0645ce5db" (UID: "762188fe-e7e1-41f7-8ebd-d6b0645ce5db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:53:29.757468 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.757266    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "762188fe-e7e1-41f7-8ebd-d6b0645ce5db" (UID: "762188fe-e7e1-41f7-8ebd-d6b0645ce5db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:53:29.856250 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.856204    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26lbg\" (UniqueName: \"kubernetes.io/projected/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-kube-api-access-26lbg\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:53:29.856250 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.856239    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:53:29.856250 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:29.856250    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762188fe-e7e1-41f7-8ebd-d6b0645ce5db-dshm\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:53:30.138993 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.138956    2569 generic.go:356] "Generic (PLEG): container finished" podID="762188fe-e7e1-41f7-8ebd-d6b0645ce5db" containerID="3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee" exitCode=0
Jul 09 17:53:30.139165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.139010    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"
Jul 09 17:53:30.139165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.139040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5" event={"ID":"762188fe-e7e1-41f7-8ebd-d6b0645ce5db","Type":"ContainerDied","Data":"3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee"}
Jul 09 17:53:30.139165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.139124    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5" event={"ID":"762188fe-e7e1-41f7-8ebd-d6b0645ce5db","Type":"ContainerDied","Data":"8fbab025a38c7f1d3ce86da02b5addddc1db850c5a9e003ebddbf7666f81af22"}
Jul 09 17:53:30.139165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.139153    2569 scope.go:117] "RemoveContainer" containerID="3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee"
Jul 09 17:53:30.149269 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.149251    2569 scope.go:117] "RemoveContainer" containerID="3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee"
Jul 09 17:53:30.149616 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:53:30.149595    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee\": container with ID starting with 3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee not found: ID does not exist" containerID="3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee"
Jul 09 17:53:30.149681 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.149626    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee"} err="failed to get container status \"3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee\": rpc error: code = NotFound desc = could not find container \"3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee\": container with ID starting with 3e731603ff9bebcf06754101d5c8b445fdd971b146236811bc0d728445d733ee not found: ID does not exist"
Jul 09 17:53:30.162125 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.162087    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"]
Jul 09 17:53:30.167460 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.167428    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5"]
Jul 09 17:53:30.401998 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.401909    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:30.509057 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:30.509013    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="762188fe-e7e1-41f7-8ebd-d6b0645ce5db" path="/var/lib/kubelet/pods/762188fe-e7e1-41f7-8ebd-d6b0645ce5db/volumes"
Jul 09 17:53:32.146651 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:32.146612    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:46.154718 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:46.154679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:46.599265 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:46.599173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:50.397494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:50.397450    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:50.465080 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:53:50.465044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:04.001319 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:04.001208    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:06.455564 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:06.455515    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:54:06.456580 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:06.456559    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:54:06.459264 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:06.459245    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:54:06.460180 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:06.460164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:54:24.633998 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:24.633966    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:24.707254 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:24.707213    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:50.923432 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:50.923397    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:51.310172 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.310081    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"]
Jul 09 17:54:51.310649 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.310634    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="762188fe-e7e1-41f7-8ebd-d6b0645ce5db" containerName="main"
Jul 09 17:54:51.310713 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.310651    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="762188fe-e7e1-41f7-8ebd-d6b0645ce5db" containerName="main"
Jul 09 17:54:51.310713 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.310710    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="762188fe-e7e1-41f7-8ebd-d6b0645ce5db" containerName="main"
Jul 09 17:54:51.313735 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.313717    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.316602 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.316579    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 17:54:51.316757 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.316581    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jul 09 17:54:51.316757 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.316649    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-hmv8v\""
Jul 09 17:54:51.321309 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.321270    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"]
Jul 09 17:54:51.339596 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.339567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:51.407787 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.407746    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/595007a9-c700-4899-8329-190107cb9ec2-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.407979 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.407826    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595007a9-c700-4899-8329-190107cb9ec2-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.407979 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.407845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjnp\" (UniqueName: \"kubernetes.io/projected/595007a9-c700-4899-8329-190107cb9ec2-kube-api-access-wcjnp\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.508677 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.508635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595007a9-c700-4899-8329-190107cb9ec2-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.508677 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.508678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjnp\" (UniqueName: \"kubernetes.io/projected/595007a9-c700-4899-8329-190107cb9ec2-kube-api-access-wcjnp\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.508951 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.508757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/595007a9-c700-4899-8329-190107cb9ec2-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.509219 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.509198    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/595007a9-c700-4899-8329-190107cb9ec2-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.511241 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.511223    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595007a9-c700-4899-8329-190107cb9ec2-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.516414 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.516391    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjnp\" (UniqueName: \"kubernetes.io/projected/595007a9-c700-4899-8329-190107cb9ec2-kube-api-access-wcjnp\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.625483 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.625451    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:51.770510 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:51.770468    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"]
Jul 09 17:54:51.773796 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:54:51.773764    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595007a9_c700_4899_8329_190107cb9ec2.slice/crio-407a5bcf5a30b170459667852c938d3014b7e8e82e9df7971825699d0ab3b71b WatchSource:0}: Error finding container 407a5bcf5a30b170459667852c938d3014b7e8e82e9df7971825699d0ab3b71b: Status 404 returned error can't find the container with id 407a5bcf5a30b170459667852c938d3014b7e8e82e9df7971825699d0ab3b71b
Jul 09 17:54:52.588569 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:52.588507    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" event={"ID":"595007a9-c700-4899-8329-190107cb9ec2","Type":"ContainerStarted","Data":"407a5bcf5a30b170459667852c938d3014b7e8e82e9df7971825699d0ab3b71b"}
Jul 09 17:54:54.601647 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:54.601148    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" event={"ID":"595007a9-c700-4899-8329-190107cb9ec2","Type":"ContainerStarted","Data":"c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e"}
Jul 09 17:54:54.602147 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:54.602130    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:54:54.623924 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:54.623865    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" podStartSLOduration=1.854197543 podStartE2EDuration="3.623848266s" totalImagesPullingTime="1.769650723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:54:54.622066706 +0000 UTC m=+948.667363218" watchObservedRunningTime="2026-07-09 17:54:54.623848266 +0000 UTC m=+948.669144776"
Jul 09 17:54:59.160163 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:54:59.160123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:25.607928 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:25.607898    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:55:26.729898 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:26.729864    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"]
Jul 09 17:55:26.740715 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:26.740684    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:26.740920 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:55:26.740896    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 17:55:26.740920 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 17:55:26.740920 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 17:55:26.740920 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e" cmd=["/bin/sleep","15"]
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:26.740941    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" message="" err=<
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:55:26.740954    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" podUID="595007a9-c700-4899-8329-190107cb9ec2" containerName="main" containerID="cri-o://c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e"
Jul 09 17:55:26.741128 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:26.741024    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" podUID="595007a9-c700-4899-8329-190107cb9ec2" containerName="main" containerID="cri-o://c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e" gracePeriod=60
Jul 09 17:55:27.020845 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.020817    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:55:27.101855 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.101817    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595007a9-c700-4899-8329-190107cb9ec2-tls-certs\") pod \"595007a9-c700-4899-8329-190107cb9ec2\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") "
Jul 09 17:55:27.102050 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.101867    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcjnp\" (UniqueName: \"kubernetes.io/projected/595007a9-c700-4899-8329-190107cb9ec2-kube-api-access-wcjnp\") pod \"595007a9-c700-4899-8329-190107cb9ec2\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") "
Jul 09 17:55:27.102050 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.101918    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/595007a9-c700-4899-8329-190107cb9ec2-tokenizer-uds\") pod \"595007a9-c700-4899-8329-190107cb9ec2\" (UID: \"595007a9-c700-4899-8329-190107cb9ec2\") "
Jul 09 17:55:27.102247 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.102219    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595007a9-c700-4899-8329-190107cb9ec2-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "595007a9-c700-4899-8329-190107cb9ec2" (UID: "595007a9-c700-4899-8329-190107cb9ec2"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:55:27.104035 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.103979    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595007a9-c700-4899-8329-190107cb9ec2-kube-api-access-wcjnp" (OuterVolumeSpecName: "kube-api-access-wcjnp") pod "595007a9-c700-4899-8329-190107cb9ec2" (UID: "595007a9-c700-4899-8329-190107cb9ec2"). InnerVolumeSpecName "kube-api-access-wcjnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:55:27.104165 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.104062    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/595007a9-c700-4899-8329-190107cb9ec2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "595007a9-c700-4899-8329-190107cb9ec2" (UID: "595007a9-c700-4899-8329-190107cb9ec2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:55:27.203253 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.203212    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595007a9-c700-4899-8329-190107cb9ec2-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:55:27.203253 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.203247    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcjnp\" (UniqueName: \"kubernetes.io/projected/595007a9-c700-4899-8329-190107cb9ec2-kube-api-access-wcjnp\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:55:27.203253 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.203257    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/595007a9-c700-4899-8329-190107cb9ec2-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:55:27.788593 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.788548    2569 generic.go:356] "Generic (PLEG): container finished" podID="595007a9-c700-4899-8329-190107cb9ec2" containerID="c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e" exitCode=0
Jul 09 17:55:27.788593 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.788593    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"
Jul 09 17:55:27.789092 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.788619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" event={"ID":"595007a9-c700-4899-8329-190107cb9ec2","Type":"ContainerDied","Data":"c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e"}
Jul 09 17:55:27.789092 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.788675    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf" event={"ID":"595007a9-c700-4899-8329-190107cb9ec2","Type":"ContainerDied","Data":"407a5bcf5a30b170459667852c938d3014b7e8e82e9df7971825699d0ab3b71b"}
Jul 09 17:55:27.789092 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.788696    2569 scope.go:117] "RemoveContainer" containerID="c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e"
Jul 09 17:55:27.799112 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.799092    2569 scope.go:117] "RemoveContainer" containerID="c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e"
Jul 09 17:55:27.799438 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:55:27.799418    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e\": container with ID starting with c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e not found: ID does not exist" containerID="c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e"
Jul 09 17:55:27.799512 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.799449    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e"} err="failed to get container status \"c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e\": rpc error: code = NotFound desc = could not find container \"c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e\": container with ID starting with c13baa3ea0bf01399c2637275287667fd777cbe55b2aea1305f1d2f17fee7e7e not found: ID does not exist"
Jul 09 17:55:27.816110 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.816079    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"]
Jul 09 17:55:27.818248 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:27.818219    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf"]
Jul 09 17:55:28.007675 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:28.007639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:28.500826 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:28.500748    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595007a9-c700-4899-8329-190107cb9ec2" path="/var/lib/kubelet/pods/595007a9-c700-4899-8329-190107cb9ec2/volumes"
Jul 09 17:55:47.387443 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:47.387411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:47.450720 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:55:47.450687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:13.139919 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.139883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:13.289760 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.289722    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"]
Jul 09 17:56:13.290148 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.290134    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595007a9-c700-4899-8329-190107cb9ec2" containerName="main"
Jul 09 17:56:13.290221 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.290150    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="595007a9-c700-4899-8329-190107cb9ec2" containerName="main"
Jul 09 17:56:13.290261 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.290225    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="595007a9-c700-4899-8329-190107cb9ec2" containerName="main"
Jul 09 17:56:13.293719 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.293690    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.296593 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.296569    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 17:56:13.296593 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.296586    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-5b1e8f15-epp-sa-dockercfg-m45sh\""
Jul 09 17:56:13.296792 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.296655    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Jul 09 17:56:13.304111 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.304069    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"]
Jul 09 17:56:13.314591 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.314544    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.314790 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.314636    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtxkv\" (UniqueName: \"kubernetes.io/projected/ed2cee5c-5149-43f6-8206-a4cfa06763e0-kube-api-access-xtxkv\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.314790 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.314665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.336820 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.336786    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:13.416068 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.415962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtxkv\" (UniqueName: \"kubernetes.io/projected/ed2cee5c-5149-43f6-8206-a4cfa06763e0-kube-api-access-xtxkv\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.416068 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.416017    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.416068 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.416049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.416513 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.416490    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.418678 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.418653    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.424325 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.424297    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtxkv\" (UniqueName: \"kubernetes.io/projected/ed2cee5c-5149-43f6-8206-a4cfa06763e0-kube-api-access-xtxkv\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.609615 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.609574    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:13.755299 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:13.755268    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"]
Jul 09 17:56:13.757593 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:56:13.757561    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2cee5c_5149_43f6_8206_a4cfa06763e0.slice/crio-c1ab1ab42fa01611fc3b9a57d2ee5d0b64a9cc38efe195826e458d9cb235853f WatchSource:0}: Error finding container c1ab1ab42fa01611fc3b9a57d2ee5d0b64a9cc38efe195826e458d9cb235853f: Status 404 returned error can't find the container with id c1ab1ab42fa01611fc3b9a57d2ee5d0b64a9cc38efe195826e458d9cb235853f
Jul 09 17:56:14.041160 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:14.041061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" event={"ID":"ed2cee5c-5149-43f6-8206-a4cfa06763e0","Type":"ContainerStarted","Data":"e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b"}
Jul 09 17:56:14.041160 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:14.041125    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" event={"ID":"ed2cee5c-5149-43f6-8206-a4cfa06763e0","Type":"ContainerStarted","Data":"c1ab1ab42fa01611fc3b9a57d2ee5d0b64a9cc38efe195826e458d9cb235853f"}
Jul 09 17:56:14.041418 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:14.041389    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:14.062474 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:14.062413    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" podStartSLOduration=1.062394091 podStartE2EDuration="1.062394091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:56:14.060256118 +0000 UTC m=+1028.105552631" watchObservedRunningTime="2026-07-09 17:56:14.062394091 +0000 UTC m=+1028.107690601"
Jul 09 17:56:30.772498 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:30.772458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:32.064848 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:32.064803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:32.176825 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:32.176792    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:33.147943 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:33.147906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:33.205451 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:33.205410    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:45.048195 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:45.048166    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:56:55.343580 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:55.343512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:55.704036 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:56:55.704000    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:19.808678 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:57:19.808593    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:20.260201 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:57:20.260158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:27.767700 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:57:27.767663    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:40.011660 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:57:40.011622    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:42.019457 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:57:42.019424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:42.092557 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:57:42.092491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:51.030031 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:57:51.029993    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:00.904493 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:00.904440    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"]
Jul 09 17:58:00.917148 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:58:00.917099    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 17:58:00.917148 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 17:58:00.917148 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 17:58:00.917148 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b" cmd=["/bin/sleep","15"]
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:00.917169    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" message="" err=<
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:58:00.917182    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" podUID="ed2cee5c-5149-43f6-8206-a4cfa06763e0" containerName="main" containerID="cri-o://e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b"
Jul 09 17:58:00.917451 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:00.917238    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" podUID="ed2cee5c-5149-43f6-8206-a4cfa06763e0" containerName="main" containerID="cri-o://e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b" gracePeriod=60
Jul 09 17:58:00.927938 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:00.927905    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:01.054691 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.054653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:01.181441 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.181410    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:58:01.287460 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.287421    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tls-certs\") pod \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") "
Jul 09 17:58:01.287732 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.287558    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtxkv\" (UniqueName: \"kubernetes.io/projected/ed2cee5c-5149-43f6-8206-a4cfa06763e0-kube-api-access-xtxkv\") pod \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") "
Jul 09 17:58:01.287732 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.287618    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tokenizer-uds\") pod \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\" (UID: \"ed2cee5c-5149-43f6-8206-a4cfa06763e0\") "
Jul 09 17:58:01.287909 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.287881    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "ed2cee5c-5149-43f6-8206-a4cfa06763e0" (UID: "ed2cee5c-5149-43f6-8206-a4cfa06763e0"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:58:01.290088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.290061    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed2cee5c-5149-43f6-8206-a4cfa06763e0" (UID: "ed2cee5c-5149-43f6-8206-a4cfa06763e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:58:01.290088 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.290074    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2cee5c-5149-43f6-8206-a4cfa06763e0-kube-api-access-xtxkv" (OuterVolumeSpecName: "kube-api-access-xtxkv") pod "ed2cee5c-5149-43f6-8206-a4cfa06763e0" (UID: "ed2cee5c-5149-43f6-8206-a4cfa06763e0"). InnerVolumeSpecName "kube-api-access-xtxkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:58:01.389008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.388970    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtxkv\" (UniqueName: \"kubernetes.io/projected/ed2cee5c-5149-43f6-8206-a4cfa06763e0-kube-api-access-xtxkv\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:58:01.389008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.389001    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:58:01.389008 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.389011    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2cee5c-5149-43f6-8206-a4cfa06763e0-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 17:58:01.638604 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.638564    2569 generic.go:356] "Generic (PLEG): container finished" podID="ed2cee5c-5149-43f6-8206-a4cfa06763e0" containerID="e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b" exitCode=0
Jul 09 17:58:01.638797 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.638617    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"
Jul 09 17:58:01.638797 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.638637    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" event={"ID":"ed2cee5c-5149-43f6-8206-a4cfa06763e0","Type":"ContainerDied","Data":"e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b"}
Jul 09 17:58:01.638797 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.638691    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp" event={"ID":"ed2cee5c-5149-43f6-8206-a4cfa06763e0","Type":"ContainerDied","Data":"c1ab1ab42fa01611fc3b9a57d2ee5d0b64a9cc38efe195826e458d9cb235853f"}
Jul 09 17:58:01.638797 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.638712    2569 scope.go:117] "RemoveContainer" containerID="e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b"
Jul 09 17:58:01.648866 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.648845    2569 scope.go:117] "RemoveContainer" containerID="e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b"
Jul 09 17:58:01.649207 ip-10-0-141-118 kubenswrapper[2569]: E0709 17:58:01.649188    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b\": container with ID starting with e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b not found: ID does not exist" containerID="e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b"
Jul 09 17:58:01.649268 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.649217    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b"} err="failed to get container status \"e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b\": rpc error: code = NotFound desc = could not find container \"e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b\": container with ID starting with e987a12740ec7812d4a36218e6e95429a288a4b0f6e04b95767550a662660d7b not found: ID does not exist"
Jul 09 17:58:01.662366 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.662334    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"]
Jul 09 17:58:01.666820 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:01.666785    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp"]
Jul 09 17:58:02.500621 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:02.500587    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2cee5c-5149-43f6-8206-a4cfa06763e0" path="/var/lib/kubelet/pods/ed2cee5c-5149-43f6-8206-a4cfa06763e0/volumes"
Jul 09 17:58:25.743939 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:25.743902    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:26.016272 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.016142    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"]
Jul 09 17:58:26.016606 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.016590    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2cee5c-5149-43f6-8206-a4cfa06763e0" containerName="main"
Jul 09 17:58:26.016668 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.016608    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2cee5c-5149-43f6-8206-a4cfa06763e0" containerName="main"
Jul 09 17:58:26.016709 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.016683    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2cee5c-5149-43f6-8206-a4cfa06763e0" containerName="main"
Jul 09 17:58:26.021096 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.021066    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.024153 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.024124    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-4b931143-epp-sa-dockercfg-j8zm6\""
Jul 09 17:58:26.024334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.024126    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 17:58:26.024334 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.024135    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Jul 09 17:58:26.032973 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.032915    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"]
Jul 09 17:58:26.050679 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.050648    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:26.112785 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.112748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.112979 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.112829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.112979 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.112911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69qmz\" (UniqueName: \"kubernetes.io/projected/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-kube-api-access-69qmz\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.214160 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.214116    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.214350 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.214178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.214350 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.214207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69qmz\" (UniqueName: \"kubernetes.io/projected/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-kube-api-access-69qmz\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.214607 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.214585    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tokenizer-uds\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.216752 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.216730    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tls-certs\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.224466 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.224442    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69qmz\" (UniqueName: \"kubernetes.io/projected/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-kube-api-access-69qmz\") pod \"llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") " pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.331675 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.331587    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.476270 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.476244    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"]
Jul 09 17:58:26.478629 ip-10-0-141-118 kubenswrapper[2569]: W0709 17:58:26.478586    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5eddbe_8e00_4434_ba54_db0eb8341a8c.slice/crio-cada6cdad6198f313ca31e3d2aee97905619844b770cc12764532890fd5db49e WatchSource:0}: Error finding container cada6cdad6198f313ca31e3d2aee97905619844b770cc12764532890fd5db49e: Status 404 returned error can't find the container with id cada6cdad6198f313ca31e3d2aee97905619844b770cc12764532890fd5db49e
Jul 09 17:58:26.778370 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.778325    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" event={"ID":"6a5eddbe-8e00-4434-ba54-db0eb8341a8c","Type":"ContainerStarted","Data":"15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909"}
Jul 09 17:58:26.778875 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.778429    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" event={"ID":"6a5eddbe-8e00-4434-ba54-db0eb8341a8c","Type":"ContainerStarted","Data":"cada6cdad6198f313ca31e3d2aee97905619844b770cc12764532890fd5db49e"}
Jul 09 17:58:26.778875 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.778521    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:58:26.796066 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:26.796011    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" podStartSLOduration=1.795992516 podStartE2EDuration="1.795992516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:58:26.795141531 +0000 UTC m=+1160.840438041" watchObservedRunningTime="2026-07-09 17:58:26.795992516 +0000 UTC m=+1160.841289027"
Jul 09 17:58:27.470172 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:27.470135    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:31.155671 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:31.155592    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:48.244427 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:48.244387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:57.786858 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:58:57.786824    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 17:59:06.490660 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:06.490632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:59:06.494860 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:06.494832    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:59:06.495203 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:06.495184    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 17:59:06.499760 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:06.499737    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 17:59:21.566605 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:21.566569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:21.768278 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:21.768245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:52.425896 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:52.425855    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:52.766494 ip-10-0-141-118 kubenswrapper[2569]: I0709 17:59:52.766398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:01.163460 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:00:01.163377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:07.328761 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:00:07.328727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:07.647754 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:00:07.647715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:22.907808 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:00:22.907776    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:51.718468 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:00:51.718432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:54.154437 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:00:54.154398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:12.137261 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.137219    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"]
Jul 09 18:01:12.147146 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:01:12.147091    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:01:12.147146 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:01:12.147146 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:01:12.147146 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909" cmd=["/bin/sleep","15"]
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.147167    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" message="" err=<
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:01:12.147186    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" podUID="6a5eddbe-8e00-4434-ba54-db0eb8341a8c" containerName="main" containerID="cri-o://15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909"
Jul 09 18:01:12.147462 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.147252    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" podUID="6a5eddbe-8e00-4434-ba54-db0eb8341a8c" containerName="main" containerID="cri-o://15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909" gracePeriod=60
Jul 09 18:01:12.174356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.174322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:12.271794 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.271745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:12.406816 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.406785    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 18:01:12.519018 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.518981    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tls-certs\") pod \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") "
Jul 09 18:01:12.519246 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.519063    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69qmz\" (UniqueName: \"kubernetes.io/projected/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-kube-api-access-69qmz\") pod \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") "
Jul 09 18:01:12.519246 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.519114    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tokenizer-uds\") pod \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\" (UID: \"6a5eddbe-8e00-4434-ba54-db0eb8341a8c\") "
Jul 09 18:01:12.519431 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.519400    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6a5eddbe-8e00-4434-ba54-db0eb8341a8c" (UID: "6a5eddbe-8e00-4434-ba54-db0eb8341a8c"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:01:12.521289 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.521265    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a5eddbe-8e00-4434-ba54-db0eb8341a8c" (UID: "6a5eddbe-8e00-4434-ba54-db0eb8341a8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:01:12.521412 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.521337    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-kube-api-access-69qmz" (OuterVolumeSpecName: "kube-api-access-69qmz") pod "6a5eddbe-8e00-4434-ba54-db0eb8341a8c" (UID: "6a5eddbe-8e00-4434-ba54-db0eb8341a8c"). InnerVolumeSpecName "kube-api-access-69qmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:01:12.619919 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.619879    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:01:12.619919 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.619910    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69qmz\" (UniqueName: \"kubernetes.io/projected/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-kube-api-access-69qmz\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:01:12.619919 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.619919    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6a5eddbe-8e00-4434-ba54-db0eb8341a8c-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:01:12.693572 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.693433    2569 generic.go:356] "Generic (PLEG): container finished" podID="6a5eddbe-8e00-4434-ba54-db0eb8341a8c" containerID="15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909" exitCode=0
Jul 09 18:01:12.693572 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.693479    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"
Jul 09 18:01:12.693572 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.693537    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" event={"ID":"6a5eddbe-8e00-4434-ba54-db0eb8341a8c","Type":"ContainerDied","Data":"15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909"}
Jul 09 18:01:12.693828 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.693592    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m" event={"ID":"6a5eddbe-8e00-4434-ba54-db0eb8341a8c","Type":"ContainerDied","Data":"cada6cdad6198f313ca31e3d2aee97905619844b770cc12764532890fd5db49e"}
Jul 09 18:01:12.693828 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.693615    2569 scope.go:117] "RemoveContainer" containerID="15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909"
Jul 09 18:01:12.704493 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.704471    2569 scope.go:117] "RemoveContainer" containerID="15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909"
Jul 09 18:01:12.704857 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:01:12.704825    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909\": container with ID starting with 15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909 not found: ID does not exist" containerID="15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909"
Jul 09 18:01:12.704976 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.704862    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909"} err="failed to get container status \"15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909\": rpc error: code = NotFound desc = could not find container \"15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909\": container with ID starting with 15342627185bcfe75547d47caac4e5eddc7670c41f81e0950d30491480412909 not found: ID does not exist"
Jul 09 18:01:12.714775 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.714742    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"]
Jul 09 18:01:12.718509 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:12.718479    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m"]
Jul 09 18:01:14.501042 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:14.501007    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5eddbe-8e00-4434-ba54-db0eb8341a8c" path="/var/lib/kubelet/pods/6a5eddbe-8e00-4434-ba54-db0eb8341a8c/volumes"
Jul 09 18:01:35.424181 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:35.424096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:35.794624 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:35.794504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:43.491197 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:43.491158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:57.152822 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:57.152781    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:57.567628 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:01:57.567518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:02:17.593192 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.593154    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"]
Jul 09 18:02:17.593705 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.593567    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5eddbe-8e00-4434-ba54-db0eb8341a8c" containerName="main"
Jul 09 18:02:17.593705 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.593580    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5eddbe-8e00-4434-ba54-db0eb8341a8c" containerName="main"
Jul 09 18:02:17.593705 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.593645    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5eddbe-8e00-4434-ba54-db0eb8341a8c" containerName="main"
Jul 09 18:02:17.598022 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.597996    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.610181 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.610153    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"]
Jul 09 18:02:17.638323 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638279    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638323 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638320    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99467636-811e-4f02-a53a-b987a7394673-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638403    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638472    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99467636-811e-4f02-a53a-b987a7394673-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638599    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.638864 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.638650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzzzt\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-kube-api-access-kzzzt\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739500 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739500 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739813 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99467636-811e-4f02-a53a-b987a7394673-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739813 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739813 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739980 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739980 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzzzt\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-kube-api-access-kzzzt\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739980 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739899    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.739980 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.739933    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99467636-811e-4f02-a53a-b987a7394673-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.740185 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.740010    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.740185 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.740145    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.740286 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.740215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.740501 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.740477    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99467636-811e-4f02-a53a-b987a7394673-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.740501 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.740489    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.742299 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.742272    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.742565 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.742546    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99467636-811e-4f02-a53a-b987a7394673-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.748057 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.748002    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.748681 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.748661    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzzzt\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-kube-api-access-kzzzt\") pod \"router-gateway-1-openshift-default-799f46c59b-rg72r\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:17.909853 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:17.909810    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:18.069849 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:18.069813    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"]
Jul 09 18:02:18.071561 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:02:18.071504    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99467636_811e_4f02_a53a_b987a7394673.slice/crio-c8f3e834c4d76793c2a41873c929137215a9f67c5ff2a94393d6f8515300473c WatchSource:0}: Error finding container c8f3e834c4d76793c2a41873c929137215a9f67c5ff2a94393d6f8515300473c: Status 404 returned error can't find the container with id c8f3e834c4d76793c2a41873c929137215a9f67c5ff2a94393d6f8515300473c
Jul 09 18:02:18.073747 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:18.073706    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:02:18.073840 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:18.073801    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:02:18.073880 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:18.073838    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:02:18.188093 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:18.187999    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"]
Jul 09 18:02:19.061820 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:19.061785    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r" event={"ID":"99467636-811e-4f02-a53a-b987a7394673","Type":"ContainerStarted","Data":"64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3"}
Jul 09 18:02:19.062357 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:19.061844    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r" event={"ID":"99467636-811e-4f02-a53a-b987a7394673","Type":"ContainerStarted","Data":"c8f3e834c4d76793c2a41873c929137215a9f67c5ff2a94393d6f8515300473c"}
Jul 09 18:02:19.094056 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:19.093991    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r" podStartSLOduration=2.09397195 podStartE2EDuration="2.09397195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:02:19.090855582 +0000 UTC m=+1393.136152097" watchObservedRunningTime="2026-07-09 18:02:19.09397195 +0000 UTC m=+1393.139268545"
Jul 09 18:02:19.909991 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:19.909953    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:19.914786 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:19.914759    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:20.068280 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:20.068157    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r" podUID="99467636-811e-4f02-a53a-b987a7394673" containerName="istio-proxy" containerID="cri-o://64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3" gracePeriod=30
Jul 09 18:02:20.068799 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:20.068341    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:20.069390 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:20.069369    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:25.333590 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.333502    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:25.420818 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.420777    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99467636-811e-4f02-a53a-b987a7394673-istiod-ca-cert\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.420818 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.420823    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzzzt\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-kube-api-access-kzzzt\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421046 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.420882    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-socket\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421046 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.420976    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-certs\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421046 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-istio-token\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421046 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421045    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-data\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421076    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99467636-811e-4f02-a53a-b987a7394673-istio-podinfo\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421101    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-credential-socket\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421129    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-envoy\") pod \"99467636-811e-4f02-a53a-b987a7394673\" (UID: \"99467636-811e-4f02-a53a-b987a7394673\") "
Jul 09 18:02:25.421251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421149    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:02:25.421471 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421378    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:02:25.421471 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421391    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99467636-811e-4f02-a53a-b987a7394673-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:02:25.421471 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421393    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-data" (OuterVolumeSpecName: "istio-data") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:02:25.421625 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421485    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-data\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.421625 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421504    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-credential-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.421625 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421519    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99467636-811e-4f02-a53a-b987a7394673-istiod-ca-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.421625 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421551    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.421797 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.421656    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:02:25.423511 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.423473    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-istio-token" (OuterVolumeSpecName: "istio-token") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:02:25.423685 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.423546    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:02:25.423685 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.423626    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99467636-811e-4f02-a53a-b987a7394673-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:02:25.423685 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.423646    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-kube-api-access-kzzzt" (OuterVolumeSpecName: "kube-api-access-kzzzt") pod "99467636-811e-4f02-a53a-b987a7394673" (UID: "99467636-811e-4f02-a53a-b987a7394673"). InnerVolumeSpecName "kube-api-access-kzzzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:02:25.522762 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.522714    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-istio-token\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.522762 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.522751    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99467636-811e-4f02-a53a-b987a7394673-istio-podinfo\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.522762 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.522763    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-istio-envoy\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.523028 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.522776    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzzzt\" (UniqueName: \"kubernetes.io/projected/99467636-811e-4f02-a53a-b987a7394673-kube-api-access-kzzzt\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:25.523028 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:25.522790    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99467636-811e-4f02-a53a-b987a7394673-workload-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:02:26.099909 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.099866    2569 generic.go:356] "Generic (PLEG): container finished" podID="99467636-811e-4f02-a53a-b987a7394673" containerID="64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3" exitCode=0
Jul 09 18:02:26.099909 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.099915    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"
Jul 09 18:02:26.100131 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.099929    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r" event={"ID":"99467636-811e-4f02-a53a-b987a7394673","Type":"ContainerDied","Data":"64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3"}
Jul 09 18:02:26.100131 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.099979    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r" event={"ID":"99467636-811e-4f02-a53a-b987a7394673","Type":"ContainerDied","Data":"c8f3e834c4d76793c2a41873c929137215a9f67c5ff2a94393d6f8515300473c"}
Jul 09 18:02:26.100131 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.100003    2569 scope.go:117] "RemoveContainer" containerID="64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3"
Jul 09 18:02:26.111773 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.111687    2569 scope.go:117] "RemoveContainer" containerID="64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3"
Jul 09 18:02:26.112488 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:02:26.112461    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3\": container with ID starting with 64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3 not found: ID does not exist" containerID="64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3"
Jul 09 18:02:26.112678 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.112495    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3"} err="failed to get container status \"64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3\": rpc error: code = NotFound desc = could not find container \"64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3\": container with ID starting with 64c2a23610a1c83307442d090b7432d6eb511026aa7fc6b39b01d63e288023f3 not found: ID does not exist"
Jul 09 18:02:26.124592 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.124554    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"]
Jul 09 18:02:26.126816 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.126780    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r"]
Jul 09 18:02:26.500111 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:26.500074    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99467636-811e-4f02-a53a-b987a7394673" path="/var/lib/kubelet/pods/99467636-811e-4f02-a53a-b987a7394673/volumes"
Jul 09 18:02:34.529021 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:34.528986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:02:43.986920 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:43.986162    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:52664->10.132.0.47:15021: read: connection reset by peer"
Jul 09 18:02:44.206645 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:44.206517    2569 generic.go:356] "Generic (PLEG): container finished" podID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerID="bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320" exitCode=0
Jul 09 18:02:44.206645 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:44.206586    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" event={"ID":"7234ec8e-0a77-48ac-b13b-ca834d41950b","Type":"ContainerDied","Data":"bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320"}
Jul 09 18:02:44.207078 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:44.207059    2569 scope.go:117] "RemoveContainer" containerID="bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320"
Jul 09 18:02:44.208356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:44.208307    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:02:44.208468 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:44.208434    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:02:44.208508 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:44.208491    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:02:45.213984 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:45.213943    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" event={"ID":"7234ec8e-0a77-48ac-b13b-ca834d41950b","Type":"ContainerStarted","Data":"80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22"}
Jul 09 18:02:45.327655 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:45.327602    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 18:02:45.328303 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:45.328135    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 18:02:46.327387 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:46.327337    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 18:02:47.326989 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:47.326874    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 18:02:48.329622 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:48.329119    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 18:02:49.327252 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:49.327193    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 18:02:50.326938 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:50.326890    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 18:02:51.331285 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:51.331249    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 18:02:51.331722 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:51.331641    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 18:02:51.332613 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:51.332590    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 18:02:51.649006 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:02:51.648971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:16.949542 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:03:16.949485    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:17.271919 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:03:17.271828    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:19.616002 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:03:19.615958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:19.716335 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:03:19.716298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:26.515251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:03:26.515214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:43.990693 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:03:43.990653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:44.197824 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:03:44.197792    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:05.791619 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:04:05.791583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:06.526376 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:04:06.526347    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:04:06.531999 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:04:06.531968    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:04:06.535812 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:04:06.535775    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:04:06.543806 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:04:06.543781    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:04:47.126515 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:04:47.126474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:58.205293 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:04:58.205249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:20.220267 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:20.220188    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:20.319681 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:20.319626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:20.438941 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:20.438886    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:20.544379 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:20.544282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:22.013734 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:22.013674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:22.078220 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:22.078187    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:22.876934 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:22.876894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:22.981290 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:22.981256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:23.616297 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:23.616242    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:33.746555 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:05:33.746486    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:08.692302 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:06:08.692183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:15.120484 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:06:15.120442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:17.821778 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:06:17.821743    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:18.088569 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:06:18.088410    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:31.452149 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:06:31.452110    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:57.716916 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:06:57.716880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:09.829967 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:07:09.829927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:08.450931 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:08.450891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:08.517584 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:08.517542    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:12.571742 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:12.571704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:12.672889 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:12.672846    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:46.251477 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:46.251419    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:47.397604 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:47.397568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:47.480330 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:47.480295    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:54.227206 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:54.227145    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:54.322290 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:08:54.322245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:09:06.573853 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:06.573824    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:09:06.578173 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:06.578147    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:09:06.582301 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:06.582277    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:09:06.586345 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:06.586323    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:09:12.670084 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:12.670043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:09:14.602298 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.602259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:09:14.663539 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.663478    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"]
Jul 09 18:09:14.663952 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.663935    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99467636-811e-4f02-a53a-b987a7394673" containerName="istio-proxy"
Jul 09 18:09:14.663952 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.663951    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="99467636-811e-4f02-a53a-b987a7394673" containerName="istio-proxy"
Jul 09 18:09:14.664073 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.664014    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="99467636-811e-4f02-a53a-b987a7394673" containerName="istio-proxy"
Jul 09 18:09:14.667102 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.667084    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.682348 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.682306    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"]
Jul 09 18:09:14.694184 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694436 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694199    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694436 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a861b6d1-7721-46c1-8e13-9199fa87625d-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694436 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694298    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694436 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694692 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694692 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bnt6\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-kube-api-access-4bnt6\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694794 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.694794 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.694757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796002 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.795961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a861b6d1-7721-46c1-8e13-9199fa87625d-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796002 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796273 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796273 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796273 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bnt6\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-kube-api-access-4bnt6\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796273 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796273 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796273 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796234    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796273 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796663 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796582    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796663 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796615    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796663 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.796920 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.797002 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.796907    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a861b6d1-7721-46c1-8e13-9199fa87625d-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.798799 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.798773    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.798950 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.798932    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.805110 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.805081    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.805361 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.805336    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bnt6\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-kube-api-access-4bnt6\") pod \"router-gateway-1-openshift-default-799f46c59b-6hn7v\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:14.984885 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:14.984846    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:15.144327 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.144297    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"]
Jul 09 18:09:15.147434 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:09:15.147401    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda861b6d1_7721_46c1_8e13_9199fa87625d.slice/crio-3da07b7da133a4a0fe84965e133e4854e0d6b747a5e71f5b70699ee13e8c741b WatchSource:0}: Error finding container 3da07b7da133a4a0fe84965e133e4854e0d6b747a5e71f5b70699ee13e8c741b: Status 404 returned error can't find the container with id 3da07b7da133a4a0fe84965e133e4854e0d6b747a5e71f5b70699ee13e8c741b
Jul 09 18:09:15.149903 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.149868    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:15.149999 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.149936    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:15.149999 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.149963    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:15.423107 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.423068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v" event={"ID":"a861b6d1-7721-46c1-8e13-9199fa87625d","Type":"ContainerStarted","Data":"9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011"}
Jul 09 18:09:15.423309 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.423123    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v" event={"ID":"a861b6d1-7721-46c1-8e13-9199fa87625d","Type":"ContainerStarted","Data":"3da07b7da133a4a0fe84965e133e4854e0d6b747a5e71f5b70699ee13e8c741b"}
Jul 09 18:09:15.446295 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.446198    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v" podStartSLOduration=1.44617015 podStartE2EDuration="1.44617015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:09:15.442813103 +0000 UTC m=+1809.488109745" watchObservedRunningTime="2026-07-09 18:09:15.44617015 +0000 UTC m=+1809.491466681"
Jul 09 18:09:15.985466 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:15.985422    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:16.991912 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:16.991879    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:17.437061 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:17.437022    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:17.438224 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:17.438203    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:17.495894 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:17.495858    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"]
Jul 09 18:09:17.496119 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:17.496086    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" containerID="cri-o://80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22" gracePeriod=30
Jul 09 18:09:18.173743 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.173699    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"]
Jul 09 18:09:18.177375 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.177346    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.190360 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.190331    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"]
Jul 09 18:09:18.229381 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c067a39f-f74b-4176-b48f-e404856ec106-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229623 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229623 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229623 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229623 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229579    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229623 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c067a39f-f74b-4176-b48f-e404856ec106-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229836 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtk5k\" (UniqueName: \"kubernetes.io/projected/c067a39f-f74b-4176-b48f-e404856ec106-kube-api-access-qtk5k\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229836 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.229836 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.229750    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c067a39f-f74b-4176-b48f-e404856ec106-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.330700 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330648    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.330946 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.330946 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c067a39f-f74b-4176-b48f-e404856ec106-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.330946 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330782    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtk5k\" (UniqueName: \"kubernetes.io/projected/c067a39f-f74b-4176-b48f-e404856ec106-kube-api-access-qtk5k\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.330946 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330847    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.330946 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c067a39f-f74b-4176-b48f-e404856ec106-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.330946 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330919    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c067a39f-f74b-4176-b48f-e404856ec106-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.331296 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.330973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.331296 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.331009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.331296 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.331258    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.331451 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.331297    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.331451 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.331351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.331598 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.331498    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.331949 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.331922    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c067a39f-f74b-4176-b48f-e404856ec106-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.333462 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.333434    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c067a39f-f74b-4176-b48f-e404856ec106-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.333851 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.333829    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c067a39f-f74b-4176-b48f-e404856ec106-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.339023 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.338980    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c067a39f-f74b-4176-b48f-e404856ec106-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.339023 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.339008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtk5k\" (UniqueName: \"kubernetes.io/projected/c067a39f-f74b-4176-b48f-e404856ec106-kube-api-access-qtk5k\") pod \"router-gateway-1-openshift-default-54c47cdfc7-hb6xz\" (UID: \"c067a39f-f74b-4176-b48f-e404856ec106\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.490755 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.490648    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:18.650265 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.650231    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"]
Jul 09 18:09:18.652722 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:09:18.652688    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc067a39f_f74b_4176_b48f_e404856ec106.slice/crio-d4ed59592b3cce4005daa4a7c39026b297781a5834c4c54e6e844b8b3d374753 WatchSource:0}: Error finding container d4ed59592b3cce4005daa4a7c39026b297781a5834c4c54e6e844b8b3d374753: Status 404 returned error can't find the container with id d4ed59592b3cce4005daa4a7c39026b297781a5834c4c54e6e844b8b3d374753
Jul 09 18:09:18.655166 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.655126    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:18.655286 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.655202    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:18.655286 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:18.655235    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:19.449724 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:19.449678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" event={"ID":"c067a39f-f74b-4176-b48f-e404856ec106","Type":"ContainerStarted","Data":"b9785bd868e00b0007c33213f404567874091ebb27ef0afb8be2df81215c6b22"}
Jul 09 18:09:19.450235 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:19.449762    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" event={"ID":"c067a39f-f74b-4176-b48f-e404856ec106","Type":"ContainerStarted","Data":"d4ed59592b3cce4005daa4a7c39026b297781a5834c4c54e6e844b8b3d374753"}
Jul 09 18:09:19.471650 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:19.471588    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" podStartSLOduration=1.471565542 podStartE2EDuration="1.471565542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:09:19.46959215 +0000 UTC m=+1813.514888677" watchObservedRunningTime="2026-07-09 18:09:19.471565542 +0000 UTC m=+1813.516862052"
Jul 09 18:09:19.491454 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:19.491414    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:19.497904 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:19.497870    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:20.458472 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:20.458435    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:20.459414 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:20.459394    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:20.522172 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:20.522045    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"]
Jul 09 18:09:20.522361 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:20.522269    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v" podUID="a861b6d1-7721-46c1-8e13-9199fa87625d" containerName="istio-proxy" containerID="cri-o://9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011" gracePeriod=30
Jul 09 18:09:21.343179 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:21.343121    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:09:22.891576 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:22.891429    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 18:09:23.088242 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088200    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7234ec8e-0a77-48ac-b13b-ca834d41950b-istiod-ca-cert\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088242 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088238    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-token\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088559 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088260    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-credential-socket\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088559 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088282    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-socket\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088559 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088408    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-certs\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088559 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088467    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-podinfo\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088559 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088496    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqptf\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-kube-api-access-zqptf\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088571    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-data\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088585    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:23.088839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088598    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:23.088839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088625    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-envoy\") pod \"7234ec8e-0a77-48ac-b13b-ca834d41950b\" (UID: \"7234ec8e-0a77-48ac-b13b-ca834d41950b\") "
Jul 09 18:09:23.088839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088698    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7234ec8e-0a77-48ac-b13b-ca834d41950b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:09:23.088839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088708    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:23.089117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088871    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:23.089117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.088988    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.089117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.089005    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-data\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.089117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.089019    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7234ec8e-0a77-48ac-b13b-ca834d41950b-istiod-ca-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.089117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.089033    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-credential-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.089117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.089048    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-workload-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.090841 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.090816    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-kube-api-access-zqptf" (OuterVolumeSpecName: "kube-api-access-zqptf") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "kube-api-access-zqptf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:09:23.090948 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.090927    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:09:23.091104 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.091086    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:23.091142 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.091096    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7234ec8e-0a77-48ac-b13b-ca834d41950b" (UID: "7234ec8e-0a77-48ac-b13b-ca834d41950b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:09:23.189861 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.189822    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-podinfo\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.189861 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.189861    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqptf\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-kube-api-access-zqptf\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.189861 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.189871    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-envoy\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.190139 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.189880    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7234ec8e-0a77-48ac-b13b-ca834d41950b-istio-token\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:23.487333 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.487229    2569 generic.go:356] "Generic (PLEG): container finished" podID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerID="80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22" exitCode=0
Jul 09 18:09:23.487333 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.487283    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"
Jul 09 18:09:23.487333 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.487294    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" event={"ID":"7234ec8e-0a77-48ac-b13b-ca834d41950b","Type":"ContainerDied","Data":"80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22"}
Jul 09 18:09:23.487333 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.487340    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m" event={"ID":"7234ec8e-0a77-48ac-b13b-ca834d41950b","Type":"ContainerDied","Data":"e4532693f062140157b6281671e20774431d46a39c5c63067f9fc6d64d8624f7"}
Jul 09 18:09:23.487757 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.487361    2569 scope.go:117] "RemoveContainer" containerID="80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22"
Jul 09 18:09:23.498594 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.498573    2569 scope.go:117] "RemoveContainer" containerID="bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320"
Jul 09 18:09:23.509691 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.509668    2569 scope.go:117] "RemoveContainer" containerID="80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22"
Jul 09 18:09:23.510075 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:09:23.510049    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22\": container with ID starting with 80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22 not found: ID does not exist" containerID="80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22"
Jul 09 18:09:23.510133 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.510091    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22"} err="failed to get container status \"80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22\": rpc error: code = NotFound desc = could not find container \"80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22\": container with ID starting with 80fbeaac30cb3ba43189cde55cfffd41c6bf3a4026e0a27845c3ff708845aa22 not found: ID does not exist"
Jul 09 18:09:23.510133 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.510119    2569 scope.go:117] "RemoveContainer" containerID="bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320"
Jul 09 18:09:23.510400 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:09:23.510378    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320\": container with ID starting with bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320 not found: ID does not exist" containerID="bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320"
Jul 09 18:09:23.510452 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.510406    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320"} err="failed to get container status \"bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320\": rpc error: code = NotFound desc = could not find container \"bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320\": container with ID starting with bf13eaa586833d0877245511e8a677708e03e670bc50cb57f284839258ec7320 not found: ID does not exist"
Jul 09 18:09:23.510507 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.510491    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"]
Jul 09 18:09:23.514091 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:23.514061    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m"]
Jul 09 18:09:24.500367 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:24.500330    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" path="/var/lib/kubelet/pods/7234ec8e-0a77-48ac-b13b-ca834d41950b/volumes"
Jul 09 18:09:25.872785 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.872758    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:25.920988 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.920955    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-podinfo\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.920988 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.920997    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a861b6d1-7721-46c1-8e13-9199fa87625d-istiod-ca-cert\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921262 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921021    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-socket\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921262 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921055    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bnt6\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-kube-api-access-4bnt6\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921262 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921084    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-envoy\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921262 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921132    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-token\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921262 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921230    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-credential-socket\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921519 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921274    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-certs\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921519 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921308    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-data\") pod \"a861b6d1-7721-46c1-8e13-9199fa87625d\" (UID: \"a861b6d1-7721-46c1-8e13-9199fa87625d\") "
Jul 09 18:09:25.921519 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921373    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:25.921519 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921521    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:25.921820 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921627    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a861b6d1-7721-46c1-8e13-9199fa87625d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:09:25.921820 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921667    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-credential-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:25.921820 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921687    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:25.921820 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.921755    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:25.922139 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.922106    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:25.923625 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.923599    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-kube-api-access-4bnt6" (OuterVolumeSpecName: "kube-api-access-4bnt6") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "kube-api-access-4bnt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:09:25.923753 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.923653    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:09:25.924029 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.924008    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:09:25.924105 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:25.924036    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a861b6d1-7721-46c1-8e13-9199fa87625d" (UID: "a861b6d1-7721-46c1-8e13-9199fa87625d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:09:26.023192 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.023149    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-token\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:26.023192 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.023186    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-workload-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:26.023192 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.023196    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-data\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:26.023192 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.023204    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-podinfo\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:26.023501 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.023212    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a861b6d1-7721-46c1-8e13-9199fa87625d-istiod-ca-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:26.023501 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.023221    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bnt6\" (UniqueName: \"kubernetes.io/projected/a861b6d1-7721-46c1-8e13-9199fa87625d-kube-api-access-4bnt6\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:26.023501 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.023231    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a861b6d1-7721-46c1-8e13-9199fa87625d-istio-envoy\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:09:26.506920 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.506884    2569 generic.go:356] "Generic (PLEG): container finished" podID="a861b6d1-7721-46c1-8e13-9199fa87625d" containerID="9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011" exitCode=0
Jul 09 18:09:26.507136 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.506936    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"
Jul 09 18:09:26.507136 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.506971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v" event={"ID":"a861b6d1-7721-46c1-8e13-9199fa87625d","Type":"ContainerDied","Data":"9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011"}
Jul 09 18:09:26.507136 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.507028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v" event={"ID":"a861b6d1-7721-46c1-8e13-9199fa87625d","Type":"ContainerDied","Data":"3da07b7da133a4a0fe84965e133e4854e0d6b747a5e71f5b70699ee13e8c741b"}
Jul 09 18:09:26.507136 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.507052    2569 scope.go:117] "RemoveContainer" containerID="9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011"
Jul 09 18:09:26.517355 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.517326    2569 scope.go:117] "RemoveContainer" containerID="9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011"
Jul 09 18:09:26.517703 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:09:26.517683    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011\": container with ID starting with 9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011 not found: ID does not exist" containerID="9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011"
Jul 09 18:09:26.517765 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.517714    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011"} err="failed to get container status \"9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011\": rpc error: code = NotFound desc = could not find container \"9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011\": container with ID starting with 9b752e4a9ba74334740a546fc8e50fea2de52ff555193ed6ff1e82f278670011 not found: ID does not exist"
Jul 09 18:09:26.536654 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.536598    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"]
Jul 09 18:09:26.542212 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:26.542161    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v"]
Jul 09 18:09:28.501044 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:28.500997    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a861b6d1-7721-46c1-8e13-9199fa87625d" path="/var/lib/kubelet/pods/a861b6d1-7721-46c1-8e13-9199fa87625d/volumes"
Jul 09 18:09:30.537000 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:30.536961    2569 generic.go:356] "Generic (PLEG): container finished" podID="c067a39f-f74b-4176-b48f-e404856ec106" containerID="b9785bd868e00b0007c33213f404567874091ebb27ef0afb8be2df81215c6b22" exitCode=0
Jul 09 18:09:30.537475 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:30.537054    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" event={"ID":"c067a39f-f74b-4176-b48f-e404856ec106","Type":"ContainerDied","Data":"b9785bd868e00b0007c33213f404567874091ebb27ef0afb8be2df81215c6b22"}
Jul 09 18:09:30.537521 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:30.537511    2569 scope.go:117] "RemoveContainer" containerID="b9785bd868e00b0007c33213f404567874091ebb27ef0afb8be2df81215c6b22"
Jul 09 18:09:30.538709 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:30.538670    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:30.538840 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:30.538748    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:30.538840 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:30.538782    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:09:31.550219 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:31.550167    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" event={"ID":"c067a39f-f74b-4176-b48f-e404856ec106","Type":"ContainerStarted","Data":"b82a6717066767f8081d6d79633e4fcd2f26e27b8364bca817cec21988300390"}
Jul 09 18:09:32.491295 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:32.491244    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:32.492883 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:32.492845    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" podUID="c067a39f-f74b-4176-b48f-e404856ec106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 09 18:09:33.491756 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:33.491712    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" podUID="c067a39f-f74b-4176-b48f-e404856ec106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 09 18:09:34.491817 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:34.491768    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" podUID="c067a39f-f74b-4176-b48f-e404856ec106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 09 18:09:35.459128 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:35.459089    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:35.491557 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:35.491484    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" podUID="c067a39f-f74b-4176-b48f-e404856ec106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 09 18:09:36.491313 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:36.491265    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz" podUID="c067a39f-f74b-4176-b48f-e404856ec106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 09 18:09:37.497220 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:37.497184    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:37.498333 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:37.498314    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz"
Jul 09 18:09:59.176645 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:09:59.176606    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:10:04.135963 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:10:04.135923    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:10:04.787962 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:10:04.787923    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:10:04.891306 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:10:04.891271    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:31.261586 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:12:31.261482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:33.519729 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:12:33.519699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:40.910690 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:12:40.910658    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:40.983075 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:12:40.983040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:53.905886 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:12:53.905850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:54.112264 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:12:54.112233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:01.407846 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:01.407812    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:21.195055 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.195017    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:21.297051 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.297020    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:21.408190 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.408147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:21.568624 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.568550    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"]
Jul 09 18:13:21.568897 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.568886    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy"
Jul 09 18:13:21.568941 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.568898    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy"
Jul 09 18:13:21.568941 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.568922    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a861b6d1-7721-46c1-8e13-9199fa87625d" containerName="istio-proxy"
Jul 09 18:13:21.568941 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.568928    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a861b6d1-7721-46c1-8e13-9199fa87625d" containerName="istio-proxy"
Jul 09 18:13:21.569042 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.568983    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy"
Jul 09 18:13:21.569042 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.568990    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a861b6d1-7721-46c1-8e13-9199fa87625d" containerName="istio-proxy"
Jul 09 18:13:21.571120 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.571105    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.576161 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.576139    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 18:13:21.577804 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.577782    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-2577e794-epp-sa-dockercfg-h47qm\""
Jul 09 18:13:21.578412 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.578390    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs\""
Jul 09 18:13:21.606031 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.606006    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"]
Jul 09 18:13:21.639417 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.639394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:21.655077 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.655056    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.655183 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.655098    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.655183 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.655126    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdkmw\" (UniqueName: \"kubernetes.io/projected/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-kube-api-access-qdkmw\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.755862 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.755839    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.755979 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.755885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.756043 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.755993    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdkmw\" (UniqueName: \"kubernetes.io/projected/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-kube-api-access-qdkmw\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.756540 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.756448    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.759245 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.759218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.766494 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.766471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdkmw\" (UniqueName: \"kubernetes.io/projected/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-kube-api-access-qdkmw\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:21.882323 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:21.882300    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:22.014194 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:22.014169    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"]
Jul 09 18:13:22.015683 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:13:22.015659    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66d8c7d_ea82_4fb6_b791_3a4900c1668a.slice/crio-b25669ecdfaece2b3226342043384c519ef7c5582e2827baaf2a26adba3b074c WatchSource:0}: Error finding container b25669ecdfaece2b3226342043384c519ef7c5582e2827baaf2a26adba3b074c: Status 404 returned error can't find the container with id b25669ecdfaece2b3226342043384c519ef7c5582e2827baaf2a26adba3b074c
Jul 09 18:13:22.802296 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:22.802266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" event={"ID":"d66d8c7d-ea82-4fb6-b791-3a4900c1668a","Type":"ContainerStarted","Data":"aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b"}
Jul 09 18:13:22.802660 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:22.802310    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" event={"ID":"d66d8c7d-ea82-4fb6-b791-3a4900c1668a","Type":"ContainerStarted","Data":"b25669ecdfaece2b3226342043384c519ef7c5582e2827baaf2a26adba3b074c"}
Jul 09 18:13:22.802660 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:22.802381    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:13:22.823057 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:22.823011    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" podStartSLOduration=1.822997955 podStartE2EDuration="1.822997955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:13:22.82059481 +0000 UTC m=+2056.865891322" watchObservedRunningTime="2026-07-09 18:13:22.822997955 +0000 UTC m=+2056.868294499"
Jul 09 18:13:33.221493 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:33.221413    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:37.876747 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:37.876714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:53.809228 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:13:53.809190    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:14:06.609002 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:06.608972    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:14:06.613102 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:06.613079    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:14:06.619627 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:06.619608    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:14:06.623123 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:06.623107    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:14:13.454973 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:13.454933    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:13.551572 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:13.551516    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:42.316659 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:42.316624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:42.376086 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:42.376055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:48.668195 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:14:48.668164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:17:01.043580 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:01.043541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:17:01.103972 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:01.103940    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:17:30.805111 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:30.805076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:17:30.996849 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:30.996817    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:17:57.001032 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:57.000995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:17:59.321437 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.321341    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:17:59.347154 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.347115    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"]
Jul 09 18:17:59.357192 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:17:59.357146    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:17:59.357192 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:17:59.357192 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:17:59.357192 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b" cmd=["/bin/sleep","15"]
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.357209    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" message="" err=<
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:17:59.357222    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" podUID="d66d8c7d-ea82-4fb6-b791-3a4900c1668a" containerName="main" containerID="cri-o://aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b"
Jul 09 18:17:59.357509 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.357268    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" podUID="d66d8c7d-ea82-4fb6-b791-3a4900c1668a" containerName="main" containerID="cri-o://aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b" gracePeriod=60
Jul 09 18:17:59.621881 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.621845    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:17:59.815726 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.815688    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tokenizer-uds\") pod \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") "
Jul 09 18:17:59.815726 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.815729    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tls-certs\") pod \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") "
Jul 09 18:17:59.815994 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.815794    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdkmw\" (UniqueName: \"kubernetes.io/projected/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-kube-api-access-qdkmw\") pod \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\" (UID: \"d66d8c7d-ea82-4fb6-b791-3a4900c1668a\") "
Jul 09 18:17:59.816062 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.816000    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "d66d8c7d-ea82-4fb6-b791-3a4900c1668a" (UID: "d66d8c7d-ea82-4fb6-b791-3a4900c1668a"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:17:59.818161 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.818130    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d66d8c7d-ea82-4fb6-b791-3a4900c1668a" (UID: "d66d8c7d-ea82-4fb6-b791-3a4900c1668a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:17:59.818281 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.818137    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-kube-api-access-qdkmw" (OuterVolumeSpecName: "kube-api-access-qdkmw") pod "d66d8c7d-ea82-4fb6-b791-3a4900c1668a" (UID: "d66d8c7d-ea82-4fb6-b791-3a4900c1668a"). InnerVolumeSpecName "kube-api-access-qdkmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:17:59.916801 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.916756    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdkmw\" (UniqueName: \"kubernetes.io/projected/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-kube-api-access-qdkmw\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:17:59.916801 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.916799    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:17:59.916801 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:17:59.916810    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66d8c7d-ea82-4fb6-b791-3a4900c1668a-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:18:00.088639 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.088602    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:18:00.296133 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.296040    2569 generic.go:356] "Generic (PLEG): container finished" podID="d66d8c7d-ea82-4fb6-b791-3a4900c1668a" containerID="aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b" exitCode=0
Jul 09 18:18:00.296133 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.296089    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"
Jul 09 18:18:00.296133 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.296100    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" event={"ID":"d66d8c7d-ea82-4fb6-b791-3a4900c1668a","Type":"ContainerDied","Data":"aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b"}
Jul 09 18:18:00.296389 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.296142    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4" event={"ID":"d66d8c7d-ea82-4fb6-b791-3a4900c1668a","Type":"ContainerDied","Data":"b25669ecdfaece2b3226342043384c519ef7c5582e2827baaf2a26adba3b074c"}
Jul 09 18:18:00.296389 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.296163    2569 scope.go:117] "RemoveContainer" containerID="aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b"
Jul 09 18:18:00.306830 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.306810    2569 scope.go:117] "RemoveContainer" containerID="aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b"
Jul 09 18:18:00.307164 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:18:00.307144    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b\": container with ID starting with aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b not found: ID does not exist" containerID="aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b"
Jul 09 18:18:00.307236 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.307173    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b"} err="failed to get container status \"aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b\": rpc error: code = NotFound desc = could not find container \"aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b\": container with ID starting with aa536cabf560331fd398c6e2fa62cd4ab99143ae0667e06ab11bd6065d2ea83b not found: ID does not exist"
Jul 09 18:18:00.318338 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.318296    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"]
Jul 09 18:18:00.323939 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.323906    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4"]
Jul 09 18:18:00.503131 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:00.503080    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d66d8c7d-ea82-4fb6-b791-3a4900c1668a" path="/var/lib/kubelet/pods/d66d8c7d-ea82-4fb6-b791-3a4900c1668a/volumes"
Jul 09 18:18:36.888188 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:36.888132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:18:37.298313 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:37.298228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:18:45.054633 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:18:45.054587    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:19:06.647004 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:19:06.646974    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:19:06.651120 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:19:06.651090    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:19:06.660979 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:19:06.660954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:19:06.664836 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:19:06.664808    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:20:30.543343 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:30.543301    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:20:30.616180 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:30.616148    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:20:51.279774 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.279728    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"]
Jul 09 18:20:51.280365 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.280337    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66d8c7d-ea82-4fb6-b791-3a4900c1668a" containerName="main"
Jul 09 18:20:51.280572 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.280551    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66d8c7d-ea82-4fb6-b791-3a4900c1668a" containerName="main"
Jul 09 18:20:51.280689 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.280604    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy"
Jul 09 18:20:51.280689 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.280614    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy"
Jul 09 18:20:51.280795 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.280766    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66d8c7d-ea82-4fb6-b791-3a4900c1668a" containerName="main"
Jul 09 18:20:51.280795 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.280785    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7234ec8e-0a77-48ac-b13b-ca834d41950b" containerName="istio-proxy"
Jul 09 18:20:51.284280 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.284252    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.286595 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.286567    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-vqn5x\""
Jul 09 18:20:51.295042 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.295007    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"]
Jul 09 18:20:51.313800 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.313765    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:20:51.382439 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.382439 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.382776 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.382776 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382639    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.382776 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbfac49-e08f-4ead-bcda-727667d75620-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.382776 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbfac49-e08f-4ead-bcda-727667d75620-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.382776 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.383035 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7xsm\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-kube-api-access-m7xsm\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.383035 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.382854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.414728 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.414688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:20:51.484352 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7xsm\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-kube-api-access-m7xsm\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484582 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484376    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484582 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484582 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484453    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484582 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484490    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484582 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484511    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484582 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbfac49-e08f-4ead-bcda-727667d75620-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484966 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484603    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbfac49-e08f-4ead-bcda-727667d75620-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484966 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484652    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.484966 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.484886    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.485129 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.485010    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.485212 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.485185    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.485271 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.485181    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.485327 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.485276    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbfac49-e08f-4ead-bcda-727667d75620-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.486986 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.486957    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.487176 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.487157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbfac49-e08f-4ead-bcda-727667d75620-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.492220 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.492184    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.492603 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.492582    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7xsm\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-kube-api-access-m7xsm\") pod \"router-gateway-2-openshift-default-54c789bdc6-fz6x9\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.598645 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.598552    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:51.754694 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.754657    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"]
Jul 09 18:20:51.756448 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:20:51.756420    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbfac49_e08f_4ead_bcda_727667d75620.slice/crio-10dd18e89fe286db7ef3d2ae764f436f75801517aa9a5806b65e16fad9832986 WatchSource:0}: Error finding container 10dd18e89fe286db7ef3d2ae764f436f75801517aa9a5806b65e16fad9832986: Status 404 returned error can't find the container with id 10dd18e89fe286db7ef3d2ae764f436f75801517aa9a5806b65e16fad9832986
Jul 09 18:20:51.762428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.762377    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:20:51.762589 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.762461    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:20:51.762589 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:51.762494    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:20:52.268112 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:52.268074    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9" event={"ID":"6dbfac49-e08f-4ead-bcda-727667d75620","Type":"ContainerStarted","Data":"92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc"}
Jul 09 18:20:52.268308 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:52.268130    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9" event={"ID":"6dbfac49-e08f-4ead-bcda-727667d75620","Type":"ContainerStarted","Data":"10dd18e89fe286db7ef3d2ae764f436f75801517aa9a5806b65e16fad9832986"}
Jul 09 18:20:52.296548 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:52.296419    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9" podStartSLOduration=1.296396996 podStartE2EDuration="1.296396996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:20:52.2916162 +0000 UTC m=+2506.336912714" watchObservedRunningTime="2026-07-09 18:20:52.296396996 +0000 UTC m=+2506.341693507"
Jul 09 18:20:52.599139 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:52.599038    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:52.604595 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:52.604565    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:53.273865 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.273831    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:53.275384 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.275358    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:20:53.567235 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.567142    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"]
Jul 09 18:20:53.570991 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.570955    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.584455 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.584426    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"]
Jul 09 18:20:53.605707 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.605667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.605862 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.605715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.605862 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.605809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.605862 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.605843    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.606117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.605868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.606117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.605896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5pl\" (UniqueName: \"kubernetes.io/projected/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-kube-api-access-8n5pl\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.606117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.606048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.606117 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.606086    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.606293 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.606122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707148 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707105    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707148 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707188    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707209    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5pl\" (UniqueName: \"kubernetes.io/projected/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-kube-api-access-8n5pl\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707278    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707302    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707338    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707844 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707772    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-data\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707905 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707840    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-credential-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.707965 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.707931    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-workload-certs\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.708031 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.708013    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-workload-socket\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.708074 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.708058    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.709808 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.709778    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-envoy\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.709939 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.709838    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-podinfo\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.715111 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.715083    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-istio-token\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.715403 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.715377    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5pl\" (UniqueName: \"kubernetes.io/projected/41d33ac8-82f8-4a88-9dc1-80a3a3f75e44-kube-api-access-8n5pl\") pod \"router-gateway-2-openshift-default-684dc9b4b9-nkv2c\" (UID: \"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:53.882593 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:53.882558    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:54.036995 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.036882    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"]
Jul 09 18:20:54.039497 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:20:54.039458    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d33ac8_82f8_4a88_9dc1_80a3a3f75e44.slice/crio-5269a75695591b4453532701eb74747413d6f6bd6b2f41e31b40f6ca90914bb3 WatchSource:0}: Error finding container 5269a75695591b4453532701eb74747413d6f6bd6b2f41e31b40f6ca90914bb3: Status 404 returned error can't find the container with id 5269a75695591b4453532701eb74747413d6f6bd6b2f41e31b40f6ca90914bb3
Jul 09 18:20:54.042473 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.042434    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:20:54.042607 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.042513    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:20:54.042607 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.042560    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:20:54.283252 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.283151    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" event={"ID":"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44","Type":"ContainerStarted","Data":"8ad432579ce2bc06a805445e7d5bdb05505bd68550c96055d4b7855ffb34c126"}
Jul 09 18:20:54.283252 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.283212    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" event={"ID":"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44","Type":"ContainerStarted","Data":"5269a75695591b4453532701eb74747413d6f6bd6b2f41e31b40f6ca90914bb3"}
Jul 09 18:20:54.305971 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.305914    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" podStartSLOduration=1.305892945 podStartE2EDuration="1.305892945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:20:54.303509432 +0000 UTC m=+2508.348805958" watchObservedRunningTime="2026-07-09 18:20:54.305892945 +0000 UTC m=+2508.351189584"
Jul 09 18:20:54.883174 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:54.883129    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:55.114240 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:55.114206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:20:55.889121 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:55.889090    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:56.298298 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:56.298210    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:56.299226 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:56.299205    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:20:56.359472 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:56.359433    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"]
Jul 09 18:20:56.359730 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:20:56.359697    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9" podUID="6dbfac49-e08f-4ead-bcda-727667d75620" containerName="istio-proxy" containerID="cri-o://92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc" gracePeriod=30
Jul 09 18:21:01.659308 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.659275    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:21:01.799181 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799070    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-socket\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799181 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799112    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-istio-token\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799181 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799159    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7xsm\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-kube-api-access-m7xsm\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799497 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799220    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-credential-socket\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799497 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799387    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbfac49-e08f-4ead-bcda-727667d75620-istiod-ca-cert\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799497 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799431    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbfac49-e08f-4ead-bcda-727667d75620-istio-podinfo\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799497 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799396    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:21:01.799497 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799468    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-data\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799497 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799498    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-envoy\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799848 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799566    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-certs\") pod \"6dbfac49-e08f-4ead-bcda-727667d75620\" (UID: \"6dbfac49-e08f-4ead-bcda-727667d75620\") "
Jul 09 18:21:01.799848 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799497    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:21:01.799848 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799694    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dbfac49-e08f-4ead-bcda-727667d75620-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:21:01.799848 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799681    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:21:01.800047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799868    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:21:01.800047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799961    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dbfac49-e08f-4ead-bcda-727667d75620-istiod-ca-cert\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.800047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799978    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-data\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.800047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.799990    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.800047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.800003    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-workload-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.800047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.800018    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-credential-socket\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.801646 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.801602    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-kube-api-access-m7xsm" (OuterVolumeSpecName: "kube-api-access-m7xsm") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "kube-api-access-m7xsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:21:01.801786 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.801710    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:21:01.802062 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.802035    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:21:01.802183 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.802032    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dbfac49-e08f-4ead-bcda-727667d75620-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dbfac49-e08f-4ead-bcda-727667d75620" (UID: "6dbfac49-e08f-4ead-bcda-727667d75620"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:21:01.901484 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.901431    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dbfac49-e08f-4ead-bcda-727667d75620-istio-podinfo\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.901484 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.901473    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dbfac49-e08f-4ead-bcda-727667d75620-istio-envoy\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.901484 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.901482    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-istio-token\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:01.901484 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:01.901491    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7xsm\" (UniqueName: \"kubernetes.io/projected/6dbfac49-e08f-4ead-bcda-727667d75620-kube-api-access-m7xsm\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:21:02.345240 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.345188    2569 generic.go:356] "Generic (PLEG): container finished" podID="6dbfac49-e08f-4ead-bcda-727667d75620" containerID="92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc" exitCode=0
Jul 09 18:21:02.345468 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.345385    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9" event={"ID":"6dbfac49-e08f-4ead-bcda-727667d75620","Type":"ContainerDied","Data":"92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc"}
Jul 09 18:21:02.345570 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.345488    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9" event={"ID":"6dbfac49-e08f-4ead-bcda-727667d75620","Type":"ContainerDied","Data":"10dd18e89fe286db7ef3d2ae764f436f75801517aa9a5806b65e16fad9832986"}
Jul 09 18:21:02.345570 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.345542    2569 scope.go:117] "RemoveContainer" containerID="92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc"
Jul 09 18:21:02.345742 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.345723    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"
Jul 09 18:21:02.364721 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.364615    2569 scope.go:117] "RemoveContainer" containerID="92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc"
Jul 09 18:21:02.365112 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:21:02.365085    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc\": container with ID starting with 92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc not found: ID does not exist" containerID="92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc"
Jul 09 18:21:02.365243 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.365126    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc"} err="failed to get container status \"92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc\": rpc error: code = NotFound desc = could not find container \"92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc\": container with ID starting with 92c7eaea4b05692049615c29d7d7a54434a411cfadd8deefadd51762e9e191dc not found: ID does not exist"
Jul 09 18:21:02.376966 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.376925    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"]
Jul 09 18:21:02.382987 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.382952    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9"]
Jul 09 18:21:02.500167 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:02.500125    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dbfac49-e08f-4ead-bcda-727667d75620" path="/var/lib/kubelet/pods/6dbfac49-e08f-4ead-bcda-727667d75620/volumes"
Jul 09 18:21:07.379363 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:07.379328    2569 generic.go:356] "Generic (PLEG): container finished" podID="41d33ac8-82f8-4a88-9dc1-80a3a3f75e44" containerID="8ad432579ce2bc06a805445e7d5bdb05505bd68550c96055d4b7855ffb34c126" exitCode=0
Jul 09 18:21:07.379954 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:07.379402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" event={"ID":"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44","Type":"ContainerDied","Data":"8ad432579ce2bc06a805445e7d5bdb05505bd68550c96055d4b7855ffb34c126"}
Jul 09 18:21:07.380027 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:07.379984    2569 scope.go:117] "RemoveContainer" containerID="8ad432579ce2bc06a805445e7d5bdb05505bd68550c96055d4b7855ffb34c126"
Jul 09 18:21:07.381088 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:07.381059    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:21:07.381158 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:07.381130    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:21:07.381191 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:07.381164    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 18:21:08.387372 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:08.387325    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" event={"ID":"41d33ac8-82f8-4a88-9dc1-80a3a3f75e44","Type":"ContainerStarted","Data":"019fe8afdc3fc74ae8e38cb511be6f72867559b13a227004f7d95b3b1a7bf9c0"}
Jul 09 18:21:08.883565 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:08.883507    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:21:08.885066 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:08.885031    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" podUID="41d33ac8-82f8-4a88-9dc1-80a3a3f75e44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 09 18:21:09.883652 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:09.883606    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" podUID="41d33ac8-82f8-4a88-9dc1-80a3a3f75e44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 09 18:21:10.883600 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:10.883517    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" podUID="41d33ac8-82f8-4a88-9dc1-80a3a3f75e44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 09 18:21:11.299240 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:11.299134    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:21:11.883584 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:11.883497    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" podUID="41d33ac8-82f8-4a88-9dc1-80a3a3f75e44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 09 18:21:12.883970 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:12.883924    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c" podUID="41d33ac8-82f8-4a88-9dc1-80a3a3f75e44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 09 18:21:13.888454 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:13.888417    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:21:13.889854 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:13.889834    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c"
Jul 09 18:21:29.318589 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:29.318552    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:29.795192 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:29.795132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:29.900409 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:29.900375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:43.183881 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:43.183841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:43.391730 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:43.391693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:43.469012 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:43.468915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:48.179478 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:48.179437    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:58.782066 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:58.782032    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:21:58.887415 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:21:58.887353    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:22:08.264149 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:22:08.264109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:22:37.190627 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:22:37.190512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:22:37.394748 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:22:37.394712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:22:49.649238 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:22:49.649200    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:23:47.447567 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:23:47.447508    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:24:06.683729 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:24:06.683697    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:24:06.687543 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:24:06.687490    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:24:06.699145 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:24:06.699119    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:24:06.702714 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:24:06.702686    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:24:34.567665 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:24:34.567625    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:24:34.645128 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:24:34.645096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:25:07.766205 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:25:07.766162    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:25:21.276551 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:25:21.276504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:25:27.380642 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:25:27.380600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:25:27.493958 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:25:27.493917    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:25:59.917164 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:25:59.917123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:05.279367 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:05.279272    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:12.791385 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:12.791345    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:40.631407 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:40.631369    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:40.750354 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:40.750305    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:40.837895 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:40.837864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:41.079027 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:41.078938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:49.223368 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:49.223331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:27:57.591185 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:27:57.591146    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:28:31.060903 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:28:31.060809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:28:39.423223 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:28:39.423190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:29:06.726975 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:29:06.726941    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:29:06.731752 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:29:06.731723    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:29:06.742475 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:29:06.742449    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:29:06.746206 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:29:06.746178    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:29:24.679002 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:29:24.678965    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:29:54.770588 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:29:54.770554    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:29:54.861449 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:29:54.861415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:30:40.168782 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:30:40.168741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:30:46.433966 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:30:46.433920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:30:46.523744 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:30:46.523711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:31:07.448727 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:07.448688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:31:07.701334 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:07.701229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:31:16.363603 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:16.363550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:31:30.762680 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.762585    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:31:30.958594 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.958555    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"]
Jul 09 18:31:30.959054 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.959035    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dbfac49-e08f-4ead-bcda-727667d75620" containerName="istio-proxy"
Jul 09 18:31:30.959153 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.959057    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dbfac49-e08f-4ead-bcda-727667d75620" containerName="istio-proxy"
Jul 09 18:31:30.959208 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.959169    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dbfac49-e08f-4ead-bcda-727667d75620" containerName="istio-proxy"
Jul 09 18:31:30.962396 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.962365    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:30.965736 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.965704    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 18:31:30.965736 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.965705    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Jul 09 18:31:30.966003 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.965746    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-epp-sa-dockercfg-rsxtx\""
Jul 09 18:31:30.975721 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:30.975691    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"]
Jul 09 18:31:31.004319 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.004279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:31:31.051737 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.051637    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97wd2\" (UniqueName: \"kubernetes.io/projected/8da8b9a8-4229-460a-8e84-b47402c1784e-kube-api-access-97wd2\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.051737 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.051683    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8da8b9a8-4229-460a-8e84-b47402c1784e-tokenizer-uds\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.051737 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.051705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8da8b9a8-4229-460a-8e84-b47402c1784e-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.152182 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.152144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97wd2\" (UniqueName: \"kubernetes.io/projected/8da8b9a8-4229-460a-8e84-b47402c1784e-kube-api-access-97wd2\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.152182 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.152186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8da8b9a8-4229-460a-8e84-b47402c1784e-tokenizer-uds\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.152435 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.152217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8da8b9a8-4229-460a-8e84-b47402c1784e-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.152658 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.152637    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8da8b9a8-4229-460a-8e84-b47402c1784e-tokenizer-uds\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.154968 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.154937    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8da8b9a8-4229-460a-8e84-b47402c1784e-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.164739 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.164705    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97wd2\" (UniqueName: \"kubernetes.io/projected/8da8b9a8-4229-460a-8e84-b47402c1784e-kube-api-access-97wd2\") pod \"scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.274917 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.274880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.431803 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.431632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"]
Jul 09 18:31:31.434372 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:31:31.434345    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da8b9a8_4229_460a_8e84_b47402c1784e.slice/crio-bc190d017c65f4fd5e46b0abc2df4acdc44c5b892616a132cc521ce74df0867a WatchSource:0}: Error finding container bc190d017c65f4fd5e46b0abc2df4acdc44c5b892616a132cc521ce74df0867a: Status 404 returned error can't find the container with id bc190d017c65f4fd5e46b0abc2df4acdc44c5b892616a132cc521ce74df0867a
Jul 09 18:31:31.958082 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.958033    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" event={"ID":"8da8b9a8-4229-460a-8e84-b47402c1784e","Type":"ContainerStarted","Data":"b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c"}
Jul 09 18:31:31.958644 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.958107    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" event={"ID":"8da8b9a8-4229-460a-8e84-b47402c1784e","Type":"ContainerStarted","Data":"bc190d017c65f4fd5e46b0abc2df4acdc44c5b892616a132cc521ce74df0867a"}
Jul 09 18:31:31.958984 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.958960    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:31:31.983251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:31.983189    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" podStartSLOduration=1.9831687850000002 podStartE2EDuration="1.983168785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:31:31.981156024 +0000 UTC m=+3146.026452535" watchObservedRunningTime="2026-07-09 18:31:31.983168785 +0000 UTC m=+3146.028465296"
Jul 09 18:31:44.772640 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:31:44.772599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:32:03.971853 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:03.971815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:32:05.261712 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.261665    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"]
Jul 09 18:32:05.268079 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.268031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:32:05.272116 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:32:05.272079    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:32:05.272116 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:32:05.272116 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:32:05.272116 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c" cmd=["/bin/sleep","15"]
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.272131    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" message="" err=<
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:32:05.272142    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" podUID="8da8b9a8-4229-460a-8e84-b47402c1784e" containerName="main" containerID="cri-o://b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c"
Jul 09 18:32:05.272402 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.272195    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" podUID="8da8b9a8-4229-460a-8e84-b47402c1784e" containerName="main" containerID="cri-o://b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c" gracePeriod=60
Jul 09 18:32:05.345147 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.345108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:32:05.541692 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.541664    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:32:05.693297 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.693253    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97wd2\" (UniqueName: \"kubernetes.io/projected/8da8b9a8-4229-460a-8e84-b47402c1784e-kube-api-access-97wd2\") pod \"8da8b9a8-4229-460a-8e84-b47402c1784e\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") "
Jul 09 18:32:05.693458 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.693325    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8da8b9a8-4229-460a-8e84-b47402c1784e-tokenizer-uds\") pod \"8da8b9a8-4229-460a-8e84-b47402c1784e\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") "
Jul 09 18:32:05.693458 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.693378    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8da8b9a8-4229-460a-8e84-b47402c1784e-tls-certs\") pod \"8da8b9a8-4229-460a-8e84-b47402c1784e\" (UID: \"8da8b9a8-4229-460a-8e84-b47402c1784e\") "
Jul 09 18:32:05.693690 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.693653    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da8b9a8-4229-460a-8e84-b47402c1784e-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "8da8b9a8-4229-460a-8e84-b47402c1784e" (UID: "8da8b9a8-4229-460a-8e84-b47402c1784e"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:32:05.695730 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.695694    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da8b9a8-4229-460a-8e84-b47402c1784e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8da8b9a8-4229-460a-8e84-b47402c1784e" (UID: "8da8b9a8-4229-460a-8e84-b47402c1784e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:32:05.695730 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.695691    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da8b9a8-4229-460a-8e84-b47402c1784e-kube-api-access-97wd2" (OuterVolumeSpecName: "kube-api-access-97wd2") pod "8da8b9a8-4229-460a-8e84-b47402c1784e" (UID: "8da8b9a8-4229-460a-8e84-b47402c1784e"). InnerVolumeSpecName "kube-api-access-97wd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:32:05.794356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.794266    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97wd2\" (UniqueName: \"kubernetes.io/projected/8da8b9a8-4229-460a-8e84-b47402c1784e-kube-api-access-97wd2\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:32:05.794356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.794295    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8da8b9a8-4229-460a-8e84-b47402c1784e-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:32:05.794356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:05.794305    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8da8b9a8-4229-460a-8e84-b47402c1784e-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:32:06.149374 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.149336    2569 generic.go:356] "Generic (PLEG): container finished" podID="8da8b9a8-4229-460a-8e84-b47402c1784e" containerID="b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c" exitCode=0
Jul 09 18:32:06.149621 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.149383    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"
Jul 09 18:32:06.149621 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.149417    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" event={"ID":"8da8b9a8-4229-460a-8e84-b47402c1784e","Type":"ContainerDied","Data":"b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c"}
Jul 09 18:32:06.149621 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.149479    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l" event={"ID":"8da8b9a8-4229-460a-8e84-b47402c1784e","Type":"ContainerDied","Data":"bc190d017c65f4fd5e46b0abc2df4acdc44c5b892616a132cc521ce74df0867a"}
Jul 09 18:32:06.149621 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.149507    2569 scope.go:117] "RemoveContainer" containerID="b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c"
Jul 09 18:32:06.160197 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.160171    2569 scope.go:117] "RemoveContainer" containerID="b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c"
Jul 09 18:32:06.160621 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:32:06.160593    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c\": container with ID starting with b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c not found: ID does not exist" containerID="b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c"
Jul 09 18:32:06.160716 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.160633    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c"} err="failed to get container status \"b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c\": rpc error: code = NotFound desc = could not find container \"b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c\": container with ID starting with b07fd9e64bd6f6fdb800eb425255e9316530b265adae7add48a8539c6c8e564c not found: ID does not exist"
Jul 09 18:32:06.175416 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.175377    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"]
Jul 09 18:32:06.178723 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.178684    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l"]
Jul 09 18:32:06.500939 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:06.500846    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da8b9a8-4229-460a-8e84-b47402c1784e" path="/var/lib/kubelet/pods/8da8b9a8-4229-460a-8e84-b47402c1784e/volumes"
Jul 09 18:32:36.736268 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.736207    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:32:36.921405 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.921367    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"]
Jul 09 18:32:36.921799 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.921785    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da8b9a8-4229-460a-8e84-b47402c1784e" containerName="main"
Jul 09 18:32:36.921799 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.921800    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da8b9a8-4229-460a-8e84-b47402c1784e" containerName="main"
Jul 09 18:32:36.921888 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.921877    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da8b9a8-4229-460a-8e84-b47402c1784e" containerName="main"
Jul 09 18:32:36.925143 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.925117    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:36.928564 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.928511    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 18:32:36.928730 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.928594    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa-dockercfg-c8jgl\""
Jul 09 18:32:36.928730 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.928511    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Jul 09 18:32:36.936379 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.936347    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"]
Jul 09 18:32:36.964520 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.964459    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:36.964763 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.964556    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzr5g\" (UniqueName: \"kubernetes.io/projected/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-kube-api-access-lzr5g\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:36.964763 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.964597    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tokenizer-uds\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:36.964763 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:36.964623    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:32:37.066238 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.066126    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tokenizer-uds\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:37.066423 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.066268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:37.066423 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.066322    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzr5g\" (UniqueName: \"kubernetes.io/projected/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-kube-api-access-lzr5g\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:37.066611 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.066590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tokenizer-uds\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:37.069213 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.069176    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:37.075338 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.075304    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzr5g\" (UniqueName: \"kubernetes.io/projected/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-kube-api-access-lzr5g\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") " pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:37.237377 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.237334    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:37.398893 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:37.398866    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"]
Jul 09 18:32:37.401006 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:32:37.400974    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ddf6cd_d5a1_4b04_aa03_f309779b2e66.slice/crio-f97fc439e2aead5632a710c1871e43fb856d280fd56f70efc7185a43e1c62228 WatchSource:0}: Error finding container f97fc439e2aead5632a710c1871e43fb856d280fd56f70efc7185a43e1c62228: Status 404 returned error can't find the container with id f97fc439e2aead5632a710c1871e43fb856d280fd56f70efc7185a43e1c62228
Jul 09 18:32:38.341251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:38.341213    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" event={"ID":"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66","Type":"ContainerStarted","Data":"6f38a0a8ef9cb501a6ee715af9e535d4b5b614648094305ea12a601ef2c9b6b7"}
Jul 09 18:32:38.341721 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:38.341289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" event={"ID":"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66","Type":"ContainerStarted","Data":"f97fc439e2aead5632a710c1871e43fb856d280fd56f70efc7185a43e1c62228"}
Jul 09 18:32:38.341721 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:38.341339    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:32:38.364660 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:38.364601    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" podStartSLOduration=2.36457937 podStartE2EDuration="2.36457937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:38.36199775 +0000 UTC m=+3212.407294261" watchObservedRunningTime="2026-07-09 18:32:38.36457937 +0000 UTC m=+3212.409875885"
Jul 09 18:32:48.114746 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:48.114711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:32:48.214861 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:48.214821    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:32:50.465337 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:32:50.465300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:09.349217 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:09.349136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:33:10.315290 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.315256    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"]
Jul 09 18:33:10.318804 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.318773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:10.325036 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:33:10.324998    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:33:10.325036 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:33:10.325036 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:33:10.325036 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="6f38a0a8ef9cb501a6ee715af9e535d4b5b614648094305ea12a601ef2c9b6b7" cmd=["/bin/sleep","15"]
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.325055    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" message="" err=<
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:33:10.325077    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" podUID="a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" containerName="main" containerID="cri-o://6f38a0a8ef9cb501a6ee715af9e535d4b5b614648094305ea12a601ef2c9b6b7"
Jul 09 18:33:10.325353 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.325124    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" podUID="a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" containerName="main" containerID="cri-o://6f38a0a8ef9cb501a6ee715af9e535d4b5b614648094305ea12a601ef2c9b6b7" gracePeriod=60
Jul 09 18:33:10.385472 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.385441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:10.526114 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.526076    2569 generic.go:356] "Generic (PLEG): container finished" podID="a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" containerID="6f38a0a8ef9cb501a6ee715af9e535d4b5b614648094305ea12a601ef2c9b6b7" exitCode=0
Jul 09 18:33:10.526279 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.526143    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" event={"ID":"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66","Type":"ContainerDied","Data":"6f38a0a8ef9cb501a6ee715af9e535d4b5b614648094305ea12a601ef2c9b6b7"}
Jul 09 18:33:10.589349 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.589322    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:33:10.679438 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.679396    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tokenizer-uds\") pod \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") "
Jul 09 18:33:10.679656 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.679453    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzr5g\" (UniqueName: \"kubernetes.io/projected/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-kube-api-access-lzr5g\") pod \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") "
Jul 09 18:33:10.679656 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.679497    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tls-certs\") pod \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\" (UID: \"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66\") "
Jul 09 18:33:10.679805 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.679783    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" (UID: "a8ddf6cd-d5a1-4b04-aa03-f309779b2e66"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:33:10.681769 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.681735    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" (UID: "a8ddf6cd-d5a1-4b04-aa03-f309779b2e66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:33:10.681915 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.681810    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-kube-api-access-lzr5g" (OuterVolumeSpecName: "kube-api-access-lzr5g") pod "a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" (UID: "a8ddf6cd-d5a1-4b04-aa03-f309779b2e66"). InnerVolumeSpecName "kube-api-access-lzr5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:33:10.780814 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.780772    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:33:10.780814 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.780807    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:33:10.780814 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:10.780817    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzr5g\" (UniqueName: \"kubernetes.io/projected/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66-kube-api-access-lzr5g\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:33:11.532830 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:11.532797    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"
Jul 09 18:33:11.533311 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:11.532802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj" event={"ID":"a8ddf6cd-d5a1-4b04-aa03-f309779b2e66","Type":"ContainerDied","Data":"f97fc439e2aead5632a710c1871e43fb856d280fd56f70efc7185a43e1c62228"}
Jul 09 18:33:11.533311 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:11.532925    2569 scope.go:117] "RemoveContainer" containerID="6f38a0a8ef9cb501a6ee715af9e535d4b5b614648094305ea12a601ef2c9b6b7"
Jul 09 18:33:11.554014 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:11.553979    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"]
Jul 09 18:33:11.558377 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:11.558346    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj"]
Jul 09 18:33:12.500191 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:12.500154    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" path="/var/lib/kubelet/pods/a8ddf6cd-d5a1-4b04-aa03-f309779b2e66/volumes"
Jul 09 18:33:12.933785 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:12.933749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:13.034804 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:13.034755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:36.227365 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:36.227330    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:36.589457 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:36.589361    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:48.946028 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:48.945995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:49.205426 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:49.205344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:33:57.195016 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:33:57.194980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:34:06.764048 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:06.763990    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:34:06.767872 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:06.767847    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:34:06.780018 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:06.779989    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:34:06.783654 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:06.783633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:34:06.955060 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:06.955022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:34:10.723005 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:10.722967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:34:10.798923 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:10.798893    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:34:38.386164 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:38.386075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:34:54.236498 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.236460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:34:54.614850 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.614762    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"]
Jul 09 18:34:54.615163 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.615148    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" containerName="main"
Jul 09 18:34:54.615230 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.615164    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" containerName="main"
Jul 09 18:34:54.615287 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.615249    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8ddf6cd-d5a1-4b04-aa03-f309779b2e66" containerName="main"
Jul 09 18:34:54.618308 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.618285    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.621951 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.621923    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-cpzlx\""
Jul 09 18:34:54.622563 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.622511    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 18:34:54.622805 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.622790    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jul 09 18:34:54.628954 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.628924    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"]
Jul 09 18:34:54.678161 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.678122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:34:54.753150 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.753110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.753150 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.753148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfg5j\" (UniqueName: \"kubernetes.io/projected/f2e8bef4-2525-451e-b676-4b3a2a68d69b-kube-api-access-pfg5j\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.753388 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.753178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.854056 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.854015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.854056 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.854057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfg5j\" (UniqueName: \"kubernetes.io/projected/f2e8bef4-2525-451e-b676-4b3a2a68d69b-kube-api-access-pfg5j\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.854274 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.854084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.854460 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.854440    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.856698 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.856676    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.863844 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.863815    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfg5j\" (UniqueName: \"kubernetes.io/projected/f2e8bef4-2525-451e-b676-4b3a2a68d69b-kube-api-access-pfg5j\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:54.931264 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:54.931224    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:55.090004 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:55.089979    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"]
Jul 09 18:34:55.092253 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:34:55.092217    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e8bef4_2525_451e_b676_4b3a2a68d69b.slice/crio-1a601792c39919d1fe99d0a30e5cdc75cc60ebb3f169f060c2ab146a59c95b51 WatchSource:0}: Error finding container 1a601792c39919d1fe99d0a30e5cdc75cc60ebb3f169f060c2ab146a59c95b51: Status 404 returned error can't find the container with id 1a601792c39919d1fe99d0a30e5cdc75cc60ebb3f169f060c2ab146a59c95b51
Jul 09 18:34:55.117839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:55.117802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" event={"ID":"f2e8bef4-2525-451e-b676-4b3a2a68d69b","Type":"ContainerStarted","Data":"1a601792c39919d1fe99d0a30e5cdc75cc60ebb3f169f060c2ab146a59c95b51"}
Jul 09 18:34:56.125797 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:56.125745    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" event={"ID":"f2e8bef4-2525-451e-b676-4b3a2a68d69b","Type":"ContainerStarted","Data":"86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88"}
Jul 09 18:34:56.126306 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:56.125815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:34:56.147969 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:34:56.147902    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" podStartSLOduration=2.147880815 podStartE2EDuration="2.147880815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:34:56.145414238 +0000 UTC m=+3350.190710749" watchObservedRunningTime="2026-07-09 18:34:56.147880815 +0000 UTC m=+3350.193177327"
Jul 09 18:35:20.344226 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:20.344192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:35:27.134799 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.134740    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 18:35:27.569186 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.569082    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"]
Jul 09 18:35:27.571073 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.571031    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 09 18:35:27.579369 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:35:27.579333    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:35:27.579369 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:35:27.579369 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:35:27.579369 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88" cmd=["/bin/sleep","15"]
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.579383    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" message="" err=<
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:35:27.579407    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerName="main" containerID="cri-o://86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88"
Jul 09 18:35:27.579684 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.579446    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerName="main" containerID="cri-o://86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88" gracePeriod=60
Jul 09 18:35:27.582324 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.582271    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:35:27.711501 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.711461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:35:27.849804 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.849777    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:35:27.957632 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.957595    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfg5j\" (UniqueName: \"kubernetes.io/projected/f2e8bef4-2525-451e-b676-4b3a2a68d69b-kube-api-access-pfg5j\") pod \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") "
Jul 09 18:35:27.957825 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.957658    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tls-certs\") pod \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") "
Jul 09 18:35:27.957825 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.957685    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tokenizer-uds\") pod \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\" (UID: \"f2e8bef4-2525-451e-b676-4b3a2a68d69b\") "
Jul 09 18:35:27.958046 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.958027    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "f2e8bef4-2525-451e-b676-4b3a2a68d69b" (UID: "f2e8bef4-2525-451e-b676-4b3a2a68d69b"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:35:27.960005 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.959965    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f2e8bef4-2525-451e-b676-4b3a2a68d69b" (UID: "f2e8bef4-2525-451e-b676-4b3a2a68d69b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:35:27.960005 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:27.959985    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e8bef4-2525-451e-b676-4b3a2a68d69b-kube-api-access-pfg5j" (OuterVolumeSpecName: "kube-api-access-pfg5j") pod "f2e8bef4-2525-451e-b676-4b3a2a68d69b" (UID: "f2e8bef4-2525-451e-b676-4b3a2a68d69b"). InnerVolumeSpecName "kube-api-access-pfg5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:35:28.058556 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.058479    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:35:28.058556 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.058513    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfg5j\" (UniqueName: \"kubernetes.io/projected/f2e8bef4-2525-451e-b676-4b3a2a68d69b-kube-api-access-pfg5j\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:35:28.058556 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.058545    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e8bef4-2525-451e-b676-4b3a2a68d69b-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:35:28.309131 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.309096    2569 generic.go:356] "Generic (PLEG): container finished" podID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerID="86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88" exitCode=0
Jul 09 18:35:28.309593 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.309152    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"
Jul 09 18:35:28.309593 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.309182    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" event={"ID":"f2e8bef4-2525-451e-b676-4b3a2a68d69b","Type":"ContainerDied","Data":"86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88"}
Jul 09 18:35:28.309593 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.309237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5" event={"ID":"f2e8bef4-2525-451e-b676-4b3a2a68d69b","Type":"ContainerDied","Data":"1a601792c39919d1fe99d0a30e5cdc75cc60ebb3f169f060c2ab146a59c95b51"}
Jul 09 18:35:28.309593 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.309264    2569 scope.go:117] "RemoveContainer" containerID="86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88"
Jul 09 18:35:28.319479 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.319460    2569 scope.go:117] "RemoveContainer" containerID="86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88"
Jul 09 18:35:28.319806 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:35:28.319783    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88\": container with ID starting with 86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88 not found: ID does not exist" containerID="86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88"
Jul 09 18:35:28.319857 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.319817    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88"} err="failed to get container status \"86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88\": rpc error: code = NotFound desc = could not find container \"86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88\": container with ID starting with 86631fca0c0038697e3cbfd299f9e98217adc4fc733120b6ba9359e5aacccc88 not found: ID does not exist"
Jul 09 18:35:28.333428 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.333394    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"]
Jul 09 18:35:28.340040 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.340008    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5"]
Jul 09 18:35:28.500670 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:28.500635    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" path="/var/lib/kubelet/pods/f2e8bef4-2525-451e-b676-4b3a2a68d69b/volumes"
Jul 09 18:35:54.999555 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:54.999503    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"]
Jul 09 18:35:55.000044 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:54.999920    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerName="main"
Jul 09 18:35:55.000044 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:54.999931    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerName="main"
Jul 09 18:35:55.000044 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:54.999991    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2e8bef4-2525-451e-b676-4b3a2a68d69b" containerName="main"
Jul 09 18:35:55.002974 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.002954    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.005962 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.005934    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Jul 09 18:35:55.006348 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.006329    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 18:35:55.017322 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.017289    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"]
Jul 09 18:35:55.043694 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.043655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:35:55.112253 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.112210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.112463 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.112272    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.112463 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.112336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.112463 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.112372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.112463 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.112416    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.112463 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.112448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khxrg\" (UniqueName: \"kubernetes.io/projected/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-kube-api-access-khxrg\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213182 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213141    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213411 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213411 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213411 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213283    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213411 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213411 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khxrg\" (UniqueName: \"kubernetes.io/projected/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-kube-api-access-khxrg\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213744 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213789 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213762    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.213825 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.213770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.215865 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.215831    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.216282 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.216259    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.225684 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.225650    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxrg\" (UniqueName: \"kubernetes.io/projected/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-kube-api-access-khxrg\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.230907 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.230875    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"]
Jul 09 18:35:55.234608 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.234584    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.237056 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.236920    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-epp-sa-dockercfg-m2flr\""
Jul 09 18:35:55.249447 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.249127    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"]
Jul 09 18:35:55.280746 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.280657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:35:55.314484 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.314446    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:35:55.314740 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.314718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.314791 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.314765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd012be7-885e-4734-9579-fd826cf88dd7-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.314846 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.314834    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.314925 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.314903    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.314981 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.314952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hxsf\" (UniqueName: \"kubernetes.io/projected/dd012be7-885e-4734-9579-fd826cf88dd7-kube-api-access-7hxsf\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.416205 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.416164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hxsf\" (UniqueName: \"kubernetes.io/projected/dd012be7-885e-4734-9579-fd826cf88dd7-kube-api-access-7hxsf\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.416397 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.416222    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.416397 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.416276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd012be7-885e-4734-9579-fd826cf88dd7-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.416397 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.416363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.416653 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.416432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.416816 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.416786    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.416976 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.416954    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-cachi2-cache\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.417176 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.417155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-uds\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.419209 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.419186    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd012be7-885e-4734-9579-fd826cf88dd7-tls-certs\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.425327 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.425295    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hxsf\" (UniqueName: \"kubernetes.io/projected/dd012be7-885e-4734-9579-fd826cf88dd7-kube-api-access-7hxsf\") pod \"scheduler-custom-template-test-kserve-router-scheduler-567695vv\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.465901 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.465871    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"]
Jul 09 18:35:55.467513 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:35:55.467486    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8bea03_d3fe_4fa1_a94c_b96f65f93a90.slice/crio-f4a475753a6c9876ade9720a924cab032d5f417e13344b5c06b2bc12bb48b740 WatchSource:0}: Error finding container f4a475753a6c9876ade9720a924cab032d5f417e13344b5c06b2bc12bb48b740: Status 404 returned error can't find the container with id f4a475753a6c9876ade9720a924cab032d5f417e13344b5c06b2bc12bb48b740
Jul 09 18:35:55.552986 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.552886    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:55.705794 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:55.705765    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"]
Jul 09 18:35:55.707571 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:35:55.707518    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd012be7_885e_4734_9579_fd826cf88dd7.slice/crio-eb56e507bc267e84a43b261e6e2554e466534bef622a32481c99d4548b1672da WatchSource:0}: Error finding container eb56e507bc267e84a43b261e6e2554e466534bef622a32481c99d4548b1672da: Status 404 returned error can't find the container with id eb56e507bc267e84a43b261e6e2554e466534bef622a32481c99d4548b1672da
Jul 09 18:35:56.476598 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:56.476557    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj" event={"ID":"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90","Type":"ContainerStarted","Data":"f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397"}
Jul 09 18:35:56.477099 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:56.476622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj" event={"ID":"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90","Type":"ContainerStarted","Data":"f4a475753a6c9876ade9720a924cab032d5f417e13344b5c06b2bc12bb48b740"}
Jul 09 18:35:56.478176 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:56.478152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" event={"ID":"dd012be7-885e-4734-9579-fd826cf88dd7","Type":"ContainerStarted","Data":"29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7"}
Jul 09 18:35:56.478286 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:56.478197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" event={"ID":"dd012be7-885e-4734-9579-fd826cf88dd7","Type":"ContainerStarted","Data":"eb56e507bc267e84a43b261e6e2554e466534bef622a32481c99d4548b1672da"}
Jul 09 18:35:56.478286 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:56.478218    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:35:56.500536 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:56.500476    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj" podStartSLOduration=2.500456163 podStartE2EDuration="2.500456163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:35:56.496801699 +0000 UTC m=+3410.542098211" watchObservedRunningTime="2026-07-09 18:35:56.500456163 +0000 UTC m=+3410.545752674"
Jul 09 18:35:56.524713 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:56.524647    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" podStartSLOduration=1.524627596 podStartE2EDuration="1.524627596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:35:56.524066907 +0000 UTC m=+3410.569363428" watchObservedRunningTime="2026-07-09 18:35:56.524627596 +0000 UTC m=+3410.569924107"
Jul 09 18:35:57.314827 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:35:57.314796    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:36:05.315684 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:05.315584    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:36:05.329156 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:05.329120    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:36:05.545892 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:05.545860    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:36:17.392264 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:17.392230    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:36:19.816719 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:19.816683    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:36:19.897873 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:19.897833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:36:27.493073 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:27.493007    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:36:29.033126 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.033091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:36:29.033757 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.033730    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"]
Jul 09 18:36:29.039297 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.039268    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"]
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:36:29.051607    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7" cmd=["/bin/sleep","15"]
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.051662    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" message="" err=<
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:36:29.051674    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" podUID="dd012be7-885e-4734-9579-fd826cf88dd7" containerName="main" containerID="cri-o://29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7"
Jul 09 18:36:29.051940 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.051715    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" podUID="dd012be7-885e-4734-9579-fd826cf88dd7" containerName="main" containerID="cri-o://29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7" gracePeriod=60
Jul 09 18:36:29.099805 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.099759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:36:29.318911 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.318881    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:36:29.459796 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.459737    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hxsf\" (UniqueName: \"kubernetes.io/projected/dd012be7-885e-4734-9579-fd826cf88dd7-kube-api-access-7hxsf\") pod \"dd012be7-885e-4734-9579-fd826cf88dd7\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") "
Jul 09 18:36:29.460009 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.459834    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd012be7-885e-4734-9579-fd826cf88dd7-tls-certs\") pod \"dd012be7-885e-4734-9579-fd826cf88dd7\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") "
Jul 09 18:36:29.460009 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.459881    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-uds\") pod \"dd012be7-885e-4734-9579-fd826cf88dd7\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") "
Jul 09 18:36:29.460009 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.459943    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-cachi2-cache\") pod \"dd012be7-885e-4734-9579-fd826cf88dd7\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") "
Jul 09 18:36:29.460189 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.460026    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-cache\") pod \"dd012be7-885e-4734-9579-fd826cf88dd7\" (UID: \"dd012be7-885e-4734-9579-fd826cf88dd7\") "
Jul 09 18:36:29.460244 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.460202    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "dd012be7-885e-4734-9579-fd826cf88dd7" (UID: "dd012be7-885e-4734-9579-fd826cf88dd7"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:36:29.460244 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.460235    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-cachi2-cache" (OuterVolumeSpecName: "cachi2-cache") pod "dd012be7-885e-4734-9579-fd826cf88dd7" (UID: "dd012be7-885e-4734-9579-fd826cf88dd7"). InnerVolumeSpecName "cachi2-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:36:29.460372 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.460355    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:29.460433 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.460373    2569 reconciler_common.go:299] "Volume detached for volume \"cachi2-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-cachi2-cache\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:29.460433 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.460367    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "dd012be7-885e-4734-9579-fd826cf88dd7" (UID: "dd012be7-885e-4734-9579-fd826cf88dd7"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:36:29.462148 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.462122    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd012be7-885e-4734-9579-fd826cf88dd7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd012be7-885e-4734-9579-fd826cf88dd7" (UID: "dd012be7-885e-4734-9579-fd826cf88dd7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:36:29.462323 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.462186    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd012be7-885e-4734-9579-fd826cf88dd7-kube-api-access-7hxsf" (OuterVolumeSpecName: "kube-api-access-7hxsf") pod "dd012be7-885e-4734-9579-fd826cf88dd7" (UID: "dd012be7-885e-4734-9579-fd826cf88dd7"). InnerVolumeSpecName "kube-api-access-7hxsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:36:29.561732 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.561636    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd012be7-885e-4734-9579-fd826cf88dd7-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:29.561732 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.561673    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd012be7-885e-4734-9579-fd826cf88dd7-tokenizer-cache\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:29.561732 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.561689    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hxsf\" (UniqueName: \"kubernetes.io/projected/dd012be7-885e-4734-9579-fd826cf88dd7-kube-api-access-7hxsf\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:29.675316 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.675275    2569 generic.go:356] "Generic (PLEG): container finished" podID="dd012be7-885e-4734-9579-fd826cf88dd7" containerID="29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7" exitCode=0
Jul 09 18:36:29.675486 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.675328    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"
Jul 09 18:36:29.675486 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.675366    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" event={"ID":"dd012be7-885e-4734-9579-fd826cf88dd7","Type":"ContainerDied","Data":"29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7"}
Jul 09 18:36:29.675486 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.675446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv" event={"ID":"dd012be7-885e-4734-9579-fd826cf88dd7","Type":"ContainerDied","Data":"eb56e507bc267e84a43b261e6e2554e466534bef622a32481c99d4548b1672da"}
Jul 09 18:36:29.675486 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.675472    2569 scope.go:117] "RemoveContainer" containerID="29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7"
Jul 09 18:36:29.685760 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.685739    2569 scope.go:117] "RemoveContainer" containerID="29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7"
Jul 09 18:36:29.686080 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:36:29.686059    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7\": container with ID starting with 29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7 not found: ID does not exist" containerID="29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7"
Jul 09 18:36:29.686161 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.686089    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7"} err="failed to get container status \"29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7\": rpc error: code = NotFound desc = could not find container \"29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7\": container with ID starting with 29293c23d82772381fcca3252faa3c23ec8ecc9f88cc3e28d3f3254dce7409c7 not found: ID does not exist"
Jul 09 18:36:29.697227 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.697195    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"]
Jul 09 18:36:29.702605 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:29.702559    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv"]
Jul 09 18:36:30.506670 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:30.506624    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd012be7-885e-4734-9579-fd826cf88dd7" path="/var/lib/kubelet/pods/dd012be7-885e-4734-9579-fd826cf88dd7/volumes"
Jul 09 18:36:44.060407 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.060340    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj" podUID="6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" containerName="main" containerID="cri-o://f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397" gracePeriod=45
Jul 09 18:36:44.331462 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.331437    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:36:44.406147 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406108    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-home\") pod \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") "
Jul 09 18:36:44.406356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406167    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-dshm\") pod \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") "
Jul 09 18:36:44.406356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406191    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tmp-dir\") pod \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") "
Jul 09 18:36:44.406356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406214    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tls-certs\") pod \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") "
Jul 09 18:36:44.406356 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406280    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-model-cache\") pod \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") "
Jul 09 18:36:44.406626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406454    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-home" (OuterVolumeSpecName: "home") pod "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" (UID: "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:36:44.406626 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406567    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" (UID: "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:36:44.406718 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406626    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-home\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:44.406718 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.406701    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" (UID: "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:36:44.408462 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.408443    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-dshm" (OuterVolumeSpecName: "dshm") pod "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" (UID: "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:36:44.408585 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.408567    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" (UID: "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:36:44.506925 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.506895    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khxrg\" (UniqueName: \"kubernetes.io/projected/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-kube-api-access-khxrg\") pod \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\" (UID: \"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90\") "
Jul 09 18:36:44.507276 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.507259    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-model-cache\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:44.507427 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.507398    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-dshm\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:44.507427 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.507425    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tmp-dir\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:44.507551 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.507439    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:44.509144 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.509118    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-kube-api-access-khxrg" (OuterVolumeSpecName: "kube-api-access-khxrg") pod "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" (UID: "6a8bea03-d3fe-4fa1-a94c-b96f65f93a90"). InnerVolumeSpecName "kube-api-access-khxrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:36:44.608043 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.607915    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khxrg\" (UniqueName: \"kubernetes.io/projected/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90-kube-api-access-khxrg\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:36:44.766003 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.765967    2569 generic.go:356] "Generic (PLEG): container finished" podID="6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" containerID="f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397" exitCode=0
Jul 09 18:36:44.766206 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.766033    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"
Jul 09 18:36:44.766206 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.766071    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj" event={"ID":"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90","Type":"ContainerDied","Data":"f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397"}
Jul 09 18:36:44.766206 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.766131    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj" event={"ID":"6a8bea03-d3fe-4fa1-a94c-b96f65f93a90","Type":"ContainerDied","Data":"f4a475753a6c9876ade9720a924cab032d5f417e13344b5c06b2bc12bb48b740"}
Jul 09 18:36:44.766206 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.766165    2569 scope.go:117] "RemoveContainer" containerID="f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397"
Jul 09 18:36:44.776562 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.776539    2569 scope.go:117] "RemoveContainer" containerID="f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397"
Jul 09 18:36:44.776856 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:36:44.776834    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397\": container with ID starting with f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397 not found: ID does not exist" containerID="f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397"
Jul 09 18:36:44.776925 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.776870    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397"} err="failed to get container status \"f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397\": rpc error: code = NotFound desc = could not find container \"f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397\": container with ID starting with f81b76ec4f6c8fb9b9c6b1825c239351a57909762bd63df42a73de2ba7646397 not found: ID does not exist"
Jul 09 18:36:44.791812 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.791774    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"]
Jul 09 18:36:44.795720 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:44.795689    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj"]
Jul 09 18:36:46.500845 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:36:46.500805    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" path="/var/lib/kubelet/pods/6a8bea03-d3fe-4fa1-a94c-b96f65f93a90/volumes"
Jul 09 18:37:01.138520 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:01.138471    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:01.445635 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:01.445501    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:10.154955 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.154918    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"]
Jul 09 18:37:10.155402 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.155338    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd012be7-885e-4734-9579-fd826cf88dd7" containerName="main"
Jul 09 18:37:10.155402 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.155350    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd012be7-885e-4734-9579-fd826cf88dd7" containerName="main"
Jul 09 18:37:10.155402 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.155373    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" containerName="main"
Jul 09 18:37:10.155402 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.155379    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" containerName="main"
Jul 09 18:37:10.155550 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.155435    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a8bea03-d3fe-4fa1-a94c-b96f65f93a90" containerName="main"
Jul 09 18:37:10.155550 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.155446    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd012be7-885e-4734-9579-fd826cf88dd7" containerName="main"
Jul 09 18:37:10.159939 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.159917    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.162635 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.162607    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 18:37:10.162794 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.162654    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 09 18:37:10.162794 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.162616    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-dockercfg-h4ptd\""
Jul 09 18:37:10.174365 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.174334    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"]
Jul 09 18:37:10.196246 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.196206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:10.255521 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.255482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.255764 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.255595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.255764 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.255635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-home\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.255764 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.255692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsd6k\" (UniqueName: \"kubernetes.io/projected/c9736b41-2884-4253-9ef0-8a77eeb3c56b-kube-api-access-gsd6k\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.255764 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.255750    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.255944 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.255774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356338 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356338 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356344    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-home\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356664 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356372    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsd6k\" (UniqueName: \"kubernetes.io/projected/c9736b41-2884-4253-9ef0-8a77eeb3c56b-kube-api-access-gsd6k\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356664 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356395    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356664 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356664 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356515    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356912 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356881    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356912 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356898    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-home\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.356997 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.356949    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.358969 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.358947    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.359230 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.359211    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.364079 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.364053    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsd6k\" (UniqueName: \"kubernetes.io/projected/c9736b41-2884-4253-9ef0-8a77eeb3c56b-kube-api-access-gsd6k\") pod \"scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.416965 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.416852    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"]
Jul 09 18:37:10.420508 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.420476    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.422958 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.422919    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-epp-sa-dockercfg-2d9ts\""
Jul 09 18:37:10.430015 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.429982    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"]
Jul 09 18:37:10.470401 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.470364    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:10.559507 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.559467    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508bb983-554e-4071-902d-621ac969f2ba-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.559507 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.559546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/508bb983-554e-4071-902d-621ac969f2ba-tokenizer-uds\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.559812 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.559583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqh5p\" (UniqueName: \"kubernetes.io/projected/508bb983-554e-4071-902d-621ac969f2ba-kube-api-access-fqh5p\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.588082 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.588043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:10.631309 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.631283    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"]
Jul 09 18:37:10.633080 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:37:10.633038    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9736b41_2884_4253_9ef0_8a77eeb3c56b.slice/crio-2b7dc5b398b0cc059b65cfc2d6724d2712baff7eb31f45870ee9511def77432b WatchSource:0}: Error finding container 2b7dc5b398b0cc059b65cfc2d6724d2712baff7eb31f45870ee9511def77432b: Status 404 returned error can't find the container with id 2b7dc5b398b0cc059b65cfc2d6724d2712baff7eb31f45870ee9511def77432b
Jul 09 18:37:10.635099 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.635077    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:37:10.661047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.661006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/508bb983-554e-4071-902d-621ac969f2ba-tokenizer-uds\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.661047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.661048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqh5p\" (UniqueName: \"kubernetes.io/projected/508bb983-554e-4071-902d-621ac969f2ba-kube-api-access-fqh5p\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.661276 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.661146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508bb983-554e-4071-902d-621ac969f2ba-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.661432 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.661410    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/508bb983-554e-4071-902d-621ac969f2ba-tokenizer-uds\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.663667 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.663647    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508bb983-554e-4071-902d-621ac969f2ba-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.669248 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.669177    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqh5p\" (UniqueName: \"kubernetes.io/projected/508bb983-554e-4071-902d-621ac969f2ba-kube-api-access-fqh5p\") pod \"scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.732205 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.732171    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:10.891364 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.891335    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"]
Jul 09 18:37:10.892820 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:37:10.892791    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508bb983_554e_4071_902d_621ac969f2ba.slice/crio-e9829f3c16623f91b0c45be8303f4b1b5cb7f677b425c927b84426d0ea4365ea WatchSource:0}: Error finding container e9829f3c16623f91b0c45be8303f4b1b5cb7f677b425c927b84426d0ea4365ea: Status 404 returned error can't find the container with id e9829f3c16623f91b0c45be8303f4b1b5cb7f677b425c927b84426d0ea4365ea
Jul 09 18:37:10.923047 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.922955    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" event={"ID":"508bb983-554e-4071-902d-621ac969f2ba","Type":"ContainerStarted","Data":"e9829f3c16623f91b0c45be8303f4b1b5cb7f677b425c927b84426d0ea4365ea"}
Jul 09 18:37:10.924388 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:10.924362    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" event={"ID":"c9736b41-2884-4253-9ef0-8a77eeb3c56b","Type":"ContainerStarted","Data":"2b7dc5b398b0cc059b65cfc2d6724d2712baff7eb31f45870ee9511def77432b"}
Jul 09 18:37:11.602490 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:11.602456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:11.932772 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:11.932731    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" event={"ID":"508bb983-554e-4071-902d-621ac969f2ba","Type":"ContainerStarted","Data":"140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec"}
Jul 09 18:37:11.932987 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:11.932807    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:11.934402 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:11.934362    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" event={"ID":"c9736b41-2884-4253-9ef0-8a77eeb3c56b","Type":"ContainerStarted","Data":"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"}
Jul 09 18:37:11.934590 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:11.934489    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:11.950014 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:11.949551    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" podStartSLOduration=1.949514344 podStartE2EDuration="1.949514344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:37:11.949318596 +0000 UTC m=+3485.994615120" watchObservedRunningTime="2026-07-09 18:37:11.949514344 +0000 UTC m=+3485.994810835"
Jul 09 18:37:12.942083 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:12.942043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" event={"ID":"c9736b41-2884-4253-9ef0-8a77eeb3c56b","Type":"ContainerStarted","Data":"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"}
Jul 09 18:37:12.963394 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:12.963327    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" podStartSLOduration=2.067008227 podStartE2EDuration="2.963305235s" totalImagesPullingTime="896.297008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:37:12.961048687 +0000 UTC m=+3487.006345195" watchObservedRunningTime="2026-07-09 18:37:12.963305235 +0000 UTC m=+3487.008601747"
Jul 09 18:37:13.470747 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:13.470703    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:20.471502 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:20.471462    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:20.484845 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:20.484813    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:21.000088 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:21.000053    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:22.006967 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:22.006936    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:37:27.599876 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:27.599842    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:41.583369 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:41.583283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:42.944100 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:42.944063    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:47.453268 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.453228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:47.495298 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.495264    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"]
Jul 09 18:37:47.506622 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:37:47.506579    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:37:47.506622 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:37:47.506622 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:37:47.506622 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec" cmd=["/bin/sleep","15"]
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.506641    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" message="" err=<
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:37:47.506660    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" podUID="508bb983-554e-4071-902d-621ac969f2ba" containerName="main" containerID="cri-o://140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec"
Jul 09 18:37:47.506937 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.506706    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" podUID="508bb983-554e-4071-902d-621ac969f2ba" containerName="main" containerID="cri-o://140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec" gracePeriod=60
Jul 09 18:37:47.516767 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.516738    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"]
Jul 09 18:37:47.576421 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.576376    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:37:47.782598 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.782566    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:47.913088 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.913030    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqh5p\" (UniqueName: \"kubernetes.io/projected/508bb983-554e-4071-902d-621ac969f2ba-kube-api-access-fqh5p\") pod \"508bb983-554e-4071-902d-621ac969f2ba\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") "
Jul 09 18:37:47.913088 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.913100    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508bb983-554e-4071-902d-621ac969f2ba-tls-certs\") pod \"508bb983-554e-4071-902d-621ac969f2ba\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") "
Jul 09 18:37:47.913777 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.913131    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/508bb983-554e-4071-902d-621ac969f2ba-tokenizer-uds\") pod \"508bb983-554e-4071-902d-621ac969f2ba\" (UID: \"508bb983-554e-4071-902d-621ac969f2ba\") "
Jul 09 18:37:47.913777 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.913460    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/508bb983-554e-4071-902d-621ac969f2ba-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "508bb983-554e-4071-902d-621ac969f2ba" (UID: "508bb983-554e-4071-902d-621ac969f2ba"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:37:47.915357 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.915327    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/508bb983-554e-4071-902d-621ac969f2ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "508bb983-554e-4071-902d-621ac969f2ba" (UID: "508bb983-554e-4071-902d-621ac969f2ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:37:47.915417 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:47.915351    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/508bb983-554e-4071-902d-621ac969f2ba-kube-api-access-fqh5p" (OuterVolumeSpecName: "kube-api-access-fqh5p") pod "508bb983-554e-4071-902d-621ac969f2ba" (UID: "508bb983-554e-4071-902d-621ac969f2ba"). InnerVolumeSpecName "kube-api-access-fqh5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:37:48.014317 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.014213    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/508bb983-554e-4071-902d-621ac969f2ba-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:37:48.014317 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.014248    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqh5p\" (UniqueName: \"kubernetes.io/projected/508bb983-554e-4071-902d-621ac969f2ba-kube-api-access-fqh5p\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:37:48.014317 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.014262    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508bb983-554e-4071-902d-621ac969f2ba-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:37:48.149903 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.149865    2569 generic.go:356] "Generic (PLEG): container finished" podID="508bb983-554e-4071-902d-621ac969f2ba" containerID="140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec" exitCode=0
Jul 09 18:37:48.150118 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.149919    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"
Jul 09 18:37:48.150118 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.149940    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" event={"ID":"508bb983-554e-4071-902d-621ac969f2ba","Type":"ContainerDied","Data":"140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec"}
Jul 09 18:37:48.150118 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.150035    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s" event={"ID":"508bb983-554e-4071-902d-621ac969f2ba","Type":"ContainerDied","Data":"e9829f3c16623f91b0c45be8303f4b1b5cb7f677b425c927b84426d0ea4365ea"}
Jul 09 18:37:48.150118 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.150066    2569 scope.go:117] "RemoveContainer" containerID="140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec"
Jul 09 18:37:48.160719 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.160696    2569 scope.go:117] "RemoveContainer" containerID="140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec"
Jul 09 18:37:48.161026 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:37:48.161004    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec\": container with ID starting with 140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec not found: ID does not exist" containerID="140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec"
Jul 09 18:37:48.161091 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.161037    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec"} err="failed to get container status \"140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec\": rpc error: code = NotFound desc = could not find container \"140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec\": container with ID starting with 140e4b46e47553291e21c057419e609ac8b5a321e81c8ddc23148c4dda6253ec not found: ID does not exist"
Jul 09 18:37:48.173726 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.173689    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"]
Jul 09 18:37:48.178754 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.178720    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s"]
Jul 09 18:37:48.501962 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:37:48.501924    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="508bb983-554e-4071-902d-621ac969f2ba" path="/var/lib/kubelet/pods/508bb983-554e-4071-902d-621ac969f2ba/volumes"
Jul 09 18:38:02.539563 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:02.539485    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="main" containerID="cri-o://bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851" gracePeriod=45
Jul 09 18:38:02.657281 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:02.657248    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="llm-d-routing-sidecar" containerID="cri-o://88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8" gracePeriod=45
Jul 09 18:38:02.924716 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:02.924684    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:38:03.058084 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058043    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-dshm\") pod \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") "
Jul 09 18:38:03.058275 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058095    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-model-cache\") pod \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") "
Jul 09 18:38:03.058275 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tls-certs\") pod \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") "
Jul 09 18:38:03.058275 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058171    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tmp-dir\") pod \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") "
Jul 09 18:38:03.058275 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058201    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-home\") pod \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") "
Jul 09 18:38:03.058508 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058281    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsd6k\" (UniqueName: \"kubernetes.io/projected/c9736b41-2884-4253-9ef0-8a77eeb3c56b-kube-api-access-gsd6k\") pod \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\" (UID: \"c9736b41-2884-4253-9ef0-8a77eeb3c56b\") "
Jul 09 18:38:03.058508 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058464    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9736b41-2884-4253-9ef0-8a77eeb3c56b" (UID: "c9736b41-2884-4253-9ef0-8a77eeb3c56b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:38:03.058671 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058504    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9736b41-2884-4253-9ef0-8a77eeb3c56b" (UID: "c9736b41-2884-4253-9ef0-8a77eeb3c56b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:38:03.058671 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058630    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-home" (OuterVolumeSpecName: "home") pod "c9736b41-2884-4253-9ef0-8a77eeb3c56b" (UID: "c9736b41-2884-4253-9ef0-8a77eeb3c56b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:38:03.058829 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058812    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-model-cache\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:03.058909 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058836    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tmp-dir\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:03.058909 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.058849    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-home\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:03.060376 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.060351    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9736b41-2884-4253-9ef0-8a77eeb3c56b" (UID: "c9736b41-2884-4253-9ef0-8a77eeb3c56b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:38:03.060819 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.060796    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-dshm" (OuterVolumeSpecName: "dshm") pod "c9736b41-2884-4253-9ef0-8a77eeb3c56b" (UID: "c9736b41-2884-4253-9ef0-8a77eeb3c56b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:38:03.060880 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.060798    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9736b41-2884-4253-9ef0-8a77eeb3c56b-kube-api-access-gsd6k" (OuterVolumeSpecName: "kube-api-access-gsd6k") pod "c9736b41-2884-4253-9ef0-8a77eeb3c56b" (UID: "c9736b41-2884-4253-9ef0-8a77eeb3c56b"). InnerVolumeSpecName "kube-api-access-gsd6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:38:03.159656 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.159616    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9736b41-2884-4253-9ef0-8a77eeb3c56b-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:03.159656 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.159648    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsd6k\" (UniqueName: \"kubernetes.io/projected/c9736b41-2884-4253-9ef0-8a77eeb3c56b-kube-api-access-gsd6k\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:03.159656 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.159657    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9736b41-2884-4253-9ef0-8a77eeb3c56b-dshm\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:03.243587 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.243545    2569 generic.go:356] "Generic (PLEG): container finished" podID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerID="bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851" exitCode=0
Jul 09 18:38:03.243587 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.243576    2569 generic.go:356] "Generic (PLEG): container finished" podID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerID="88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8" exitCode=0
Jul 09 18:38:03.243845 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.243616    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"
Jul 09 18:38:03.243845 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.243637    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" event={"ID":"c9736b41-2884-4253-9ef0-8a77eeb3c56b","Type":"ContainerDied","Data":"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"}
Jul 09 18:38:03.243845 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.243697    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" event={"ID":"c9736b41-2884-4253-9ef0-8a77eeb3c56b","Type":"ContainerDied","Data":"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"}
Jul 09 18:38:03.243845 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.243721    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s" event={"ID":"c9736b41-2884-4253-9ef0-8a77eeb3c56b","Type":"ContainerDied","Data":"2b7dc5b398b0cc059b65cfc2d6724d2712baff7eb31f45870ee9511def77432b"}
Jul 09 18:38:03.243845 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.243741    2569 scope.go:117] "RemoveContainer" containerID="bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"
Jul 09 18:38:03.254098 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.254077    2569 scope.go:117] "RemoveContainer" containerID="88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"
Jul 09 18:38:03.266884 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.266855    2569 scope.go:117] "RemoveContainer" containerID="bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"
Jul 09 18:38:03.267368 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:38:03.267336    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851\": container with ID starting with bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851 not found: ID does not exist" containerID="bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"
Jul 09 18:38:03.267505 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.267379    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"} err="failed to get container status \"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851\": rpc error: code = NotFound desc = could not find container \"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851\": container with ID starting with bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851 not found: ID does not exist"
Jul 09 18:38:03.267505 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.267405    2569 scope.go:117] "RemoveContainer" containerID="88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"
Jul 09 18:38:03.267874 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:38:03.267841    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8\": container with ID starting with 88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8 not found: ID does not exist" containerID="88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"
Jul 09 18:38:03.267958 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.267883    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"} err="failed to get container status \"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8\": rpc error: code = NotFound desc = could not find container \"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8\": container with ID starting with 88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8 not found: ID does not exist"
Jul 09 18:38:03.267958 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.267906    2569 scope.go:117] "RemoveContainer" containerID="bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"
Jul 09 18:38:03.268182 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.268159    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851"} err="failed to get container status \"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851\": rpc error: code = NotFound desc = could not find container \"bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851\": container with ID starting with bccf2257d4f178b310dc40abfa4fe35856bf0085e41a1e75135680f1f84d5851 not found: ID does not exist"
Jul 09 18:38:03.268182 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.268181    2569 scope.go:117] "RemoveContainer" containerID="88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"
Jul 09 18:38:03.268499 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.268471    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8"} err="failed to get container status \"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8\": rpc error: code = NotFound desc = could not find container \"88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8\": container with ID starting with 88c0ffc6ccc0dc6a166cbb0652d08c8c26e60d6990d8a89fdb16d68608a82bd8 not found: ID does not exist"
Jul 09 18:38:03.269861 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.269836    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"]
Jul 09 18:38:03.274498 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:03.274470    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s"]
Jul 09 18:38:04.500543 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:04.500488    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" path="/var/lib/kubelet/pods/c9736b41-2884-4253-9ef0-8a77eeb3c56b/volumes"
Jul 09 18:38:23.005354 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.005314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:23.426376 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.426335    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"]
Jul 09 18:38:23.427056 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427028    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508bb983-554e-4071-902d-621ac969f2ba" containerName="main"
Jul 09 18:38:23.427056 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427055    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="508bb983-554e-4071-902d-621ac969f2ba" containerName="main"
Jul 09 18:38:23.427211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427075    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="llm-d-routing-sidecar"
Jul 09 18:38:23.427211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427081    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="llm-d-routing-sidecar"
Jul 09 18:38:23.427211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427096    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="main"
Jul 09 18:38:23.427211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427104    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="main"
Jul 09 18:38:23.427211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427165    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="llm-d-routing-sidecar"
Jul 09 18:38:23.427211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427180    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9736b41-2884-4253-9ef0-8a77eeb3c56b" containerName="main"
Jul 09 18:38:23.427211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.427188    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="508bb983-554e-4071-902d-621ac969f2ba" containerName="main"
Jul 09 18:38:23.430290 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.430270    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.434201 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.434159    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg56t\""
Jul 09 18:38:23.434364 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.434299    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-epp-sa-dockercfg-wlcgw\""
Jul 09 18:38:23.434433 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.434160    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Jul 09 18:38:23.446738 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.446707    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"]
Jul 09 18:38:23.462316 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.462277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:23.554182 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.554139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97004a0e-b50a-4003-a382-2dd73c9bdb81-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.554375 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.554233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr885\" (UniqueName: \"kubernetes.io/projected/97004a0e-b50a-4003-a382-2dd73c9bdb81-kube-api-access-kr885\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.554375 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.554284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97004a0e-b50a-4003-a382-2dd73c9bdb81-tokenizer-uds\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.655149 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.655106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97004a0e-b50a-4003-a382-2dd73c9bdb81-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.655339 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.655161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr885\" (UniqueName: \"kubernetes.io/projected/97004a0e-b50a-4003-a382-2dd73c9bdb81-kube-api-access-kr885\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.655339 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.655210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97004a0e-b50a-4003-a382-2dd73c9bdb81-tokenizer-uds\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.655638 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.655621    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97004a0e-b50a-4003-a382-2dd73c9bdb81-tokenizer-uds\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.657859 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.657830    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97004a0e-b50a-4003-a382-2dd73c9bdb81-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.664479 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.664451    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr885\" (UniqueName: \"kubernetes.io/projected/97004a0e-b50a-4003-a382-2dd73c9bdb81-kube-api-access-kr885\") pod \"scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.747289 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.747182    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:23.905058 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:23.905028    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"]
Jul 09 18:38:23.906252 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:38:23.906226    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97004a0e_b50a_4003_a382_2dd73c9bdb81.slice/crio-c0b3207920f6ab79b594b766aa76f6489d9e4ea835164816723bd7f2804c552e WatchSource:0}: Error finding container c0b3207920f6ab79b594b766aa76f6489d9e4ea835164816723bd7f2804c552e: Status 404 returned error can't find the container with id c0b3207920f6ab79b594b766aa76f6489d9e4ea835164816723bd7f2804c552e
Jul 09 18:38:24.367711 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:24.367675    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" event={"ID":"97004a0e-b50a-4003-a382-2dd73c9bdb81","Type":"ContainerStarted","Data":"0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa"}
Jul 09 18:38:24.368115 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:24.367732    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" event={"ID":"97004a0e-b50a-4003-a382-2dd73c9bdb81","Type":"ContainerStarted","Data":"c0b3207920f6ab79b594b766aa76f6489d9e4ea835164816723bd7f2804c552e"}
Jul 09 18:38:24.368115 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:24.367751    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:24.386671 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:24.386614    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" podStartSLOduration=1.386596202 podStartE2EDuration="1.386596202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:38:24.385894356 +0000 UTC m=+3558.431190868" watchObservedRunningTime="2026-07-09 18:38:24.386596202 +0000 UTC m=+3558.431892713"
Jul 09 18:38:27.107922 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:27.107882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:27.204166 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:27.204104    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:32.604476 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:32.604418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:36.175036 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:36.174973    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:55.376444 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:55.376413    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:56.840878 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:56.840839    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"]
Jul 09 18:38:56.846854 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:56.846808    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:56.851023 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:38:56.850977    2569 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 09 18:38:56.851023 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:38:56.851023 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:38:56.851023 ip-10-0-141-118 kubenswrapper[2569]:  > containerID="0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa" cmd=["/bin/sleep","15"]
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:56.851034    2569 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" message="" err=<
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]:  >
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:38:56.851048    2569 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]:         , stdout: , stderr: , exit code -1
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]:  > pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" podUID="97004a0e-b50a-4003-a382-2dd73c9bdb81" containerName="main" containerID="cri-o://0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa"
Jul 09 18:38:56.851300 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:56.851101    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" podUID="97004a0e-b50a-4003-a382-2dd73c9bdb81" containerName="main" containerID="cri-o://0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa" gracePeriod=60
Jul 09 18:38:56.914084 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:56.914052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:38:57.118425 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.118395    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:57.185979 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.185939    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr885\" (UniqueName: \"kubernetes.io/projected/97004a0e-b50a-4003-a382-2dd73c9bdb81-kube-api-access-kr885\") pod \"97004a0e-b50a-4003-a382-2dd73c9bdb81\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") "
Jul 09 18:38:57.186158 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.186000    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97004a0e-b50a-4003-a382-2dd73c9bdb81-tls-certs\") pod \"97004a0e-b50a-4003-a382-2dd73c9bdb81\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") "
Jul 09 18:38:57.186158 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.186029    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97004a0e-b50a-4003-a382-2dd73c9bdb81-tokenizer-uds\") pod \"97004a0e-b50a-4003-a382-2dd73c9bdb81\" (UID: \"97004a0e-b50a-4003-a382-2dd73c9bdb81\") "
Jul 09 18:38:57.186391 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.186362    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97004a0e-b50a-4003-a382-2dd73c9bdb81-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "97004a0e-b50a-4003-a382-2dd73c9bdb81" (UID: "97004a0e-b50a-4003-a382-2dd73c9bdb81"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:38:57.188399 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.188366    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97004a0e-b50a-4003-a382-2dd73c9bdb81-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97004a0e-b50a-4003-a382-2dd73c9bdb81" (UID: "97004a0e-b50a-4003-a382-2dd73c9bdb81"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:38:57.188399 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.188385    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97004a0e-b50a-4003-a382-2dd73c9bdb81-kube-api-access-kr885" (OuterVolumeSpecName: "kube-api-access-kr885") pod "97004a0e-b50a-4003-a382-2dd73c9bdb81" (UID: "97004a0e-b50a-4003-a382-2dd73c9bdb81"). InnerVolumeSpecName "kube-api-access-kr885". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:38:57.286759 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.286696    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr885\" (UniqueName: \"kubernetes.io/projected/97004a0e-b50a-4003-a382-2dd73c9bdb81-kube-api-access-kr885\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:57.286759 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.286752    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97004a0e-b50a-4003-a382-2dd73c9bdb81-tls-certs\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:57.286759 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.286766    2569 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97004a0e-b50a-4003-a382-2dd73c9bdb81-tokenizer-uds\") on node \"ip-10-0-141-118.ec2.internal\" DevicePath \"\""
Jul 09 18:38:57.567083 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.567048    2569 generic.go:356] "Generic (PLEG): container finished" podID="97004a0e-b50a-4003-a382-2dd73c9bdb81" containerID="0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa" exitCode=0
Jul 09 18:38:57.567276 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.567091    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"
Jul 09 18:38:57.567276 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.567102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" event={"ID":"97004a0e-b50a-4003-a382-2dd73c9bdb81","Type":"ContainerDied","Data":"0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa"}
Jul 09 18:38:57.567276 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.567155    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq" event={"ID":"97004a0e-b50a-4003-a382-2dd73c9bdb81","Type":"ContainerDied","Data":"c0b3207920f6ab79b594b766aa76f6489d9e4ea835164816723bd7f2804c552e"}
Jul 09 18:38:57.567276 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.567175    2569 scope.go:117] "RemoveContainer" containerID="0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa"
Jul 09 18:38:57.577553 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.577517    2569 scope.go:117] "RemoveContainer" containerID="0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa"
Jul 09 18:38:57.577894 ip-10-0-141-118 kubenswrapper[2569]: E0709 18:38:57.577868    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa\": container with ID starting with 0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa not found: ID does not exist" containerID="0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa"
Jul 09 18:38:57.577971 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.577902    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa"} err="failed to get container status \"0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa\": rpc error: code = NotFound desc = could not find container \"0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa\": container with ID starting with 0f1f3ea8a64a19e7f0f0365febcfe6e98fe2ebd13bad68807d9a4e00d88eebfa not found: ID does not exist"
Jul 09 18:38:57.589739 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.589703    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"]
Jul 09 18:38:57.593458 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:57.593405    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq"]
Jul 09 18:38:58.500978 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:38:58.500896    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97004a0e-b50a-4003-a382-2dd73c9bdb81" path="/var/lib/kubelet/pods/97004a0e-b50a-4003-a382-2dd73c9bdb81/volumes"
Jul 09 18:39:06.799981 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:39:06.799949    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:39:06.803934 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:39:06.803910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:39:06.816732 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:39:06.816708    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:39:06.820345 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:39:06.820320    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sc5lg_87ca8c12-18c1-42cf-939b-d23596f4e426/ovn-acl-logging/0.log"
Jul 09 18:39:37.352095 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:39:37.352051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:40:01.513422 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:01.513390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:40:03.650131 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:03.650095    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:40:18.297414 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:18.297376    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:18.297917 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:18.297710    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:18.309434 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:18.309383    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:18.309956 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:18.309942    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:19.994972 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:19.994943    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:19.995431 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:19.995282    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:20.009305 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:20.009275    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:20.009800 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:20.009775    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:21.668976 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:21.668945    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:21.669483 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:21.669217    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:21.682323 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:21.682288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:21.682803 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:21.682787    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:23.272734 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:23.272701    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:23.273272 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:23.273120    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:23.285181 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:23.285157    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:23.285404 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:23.285392    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:25.004730 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:25.004696    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:25.005152 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:25.005060    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:25.017178 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:25.017146    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:25.017625 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:25.017607    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:26.643503 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:26.643471    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:26.644007 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:26.643798    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:26.663471 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:26.663445    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:26.663929 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:26.663913    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:28.360377 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:28.360344    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:28.360863 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:28.360640    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:28.379177 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:28.379105    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:28.379429 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:28.379410    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:30.072624 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:30.072591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:30.073013 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:30.072816    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:30.085285 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:30.085258    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:30.085654 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:30.085640    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:31.740619 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:31.740582    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:31.741040 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:31.740821    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:31.771271 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:31.771236    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:31.771659 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:31.771643    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:33.404655 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:33.404621    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:33.405089 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:33.404857    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:33.419850 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:33.419822    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:33.420103 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:33.420088    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:35.037032 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:35.037004    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:35.037434 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:35.037301    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:35.050231 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:35.050200    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:35.050771 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:35.050750    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:36.703849 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:36.703807    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:36.704276 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:36.704054    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:36.716021 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:36.715990    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:36.716305 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:36.716289    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:38.329987 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:38.329950    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:38.330494 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:38.330350    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:38.343051 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:38.343027    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:38.346211 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:38.346180    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:39.886146 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:39.886110    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:39.886665 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:39.886442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:39.903072 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:39.903046    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:39.903362 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:39.903346    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:41.514479 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:41.514445    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:41.514969 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:41.514855    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:41.527209 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:41.527172    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:41.527639 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:41.527613    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:43.113659 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:43.113625    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/1.log"
Jul 09 18:40:43.114122 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:43.113884    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-hb6xz_c067a39f-f74b-4176-b48f-e404856ec106/istio-proxy/0.log"
Jul 09 18:40:43.125721 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:43.125691    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/1.log"
Jul 09 18:40:43.126120 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:43.126096    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-684dc9b4b9-nkv2c_41d33ac8-82f8-4a88-9dc1-80a3a3f75e44/istio-proxy/0.log"
Jul 09 18:40:45.425630 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:45.425586    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9b99_048c2191-0e89-4fe1-bcef-eb137d8dd186/discovery/0.log"
Jul 09 18:40:45.522069 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:45.522040    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc67f59d-8gfgw_747e8e45-5c52-4275-baa8-3218cdbfb8e8/router/0.log"
Jul 09 18:40:47.293003 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:47.292966    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9b99_048c2191-0e89-4fe1-bcef-eb137d8dd186/discovery/0.log"
Jul 09 18:40:47.402483 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:47.402443    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc67f59d-8gfgw_747e8e45-5c52-4275-baa8-3218cdbfb8e8/router/0.log"
Jul 09 18:40:49.202304 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:49.202257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9b99_048c2191-0e89-4fe1-bcef-eb137d8dd186/discovery/0.log"
Jul 09 18:40:49.313688 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:49.313648    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc67f59d-8gfgw_747e8e45-5c52-4275-baa8-3218cdbfb8e8/router/0.log"
Jul 09 18:40:51.062285 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:51.062235    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9b99_048c2191-0e89-4fe1-bcef-eb137d8dd186/discovery/0.log"
Jul 09 18:40:51.170146 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:51.170116    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc67f59d-8gfgw_747e8e45-5c52-4275-baa8-3218cdbfb8e8/router/0.log"
Jul 09 18:40:52.189099 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:52.189065    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:40:52.206285 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:52.206259    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:40:52.224685 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:52.224657    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:40:52.238559 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:52.238517    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:40:52.524387 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:52.524291    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:40:53.621036 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:53.621001    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:40:53.637902 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:53.637864    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:40:53.656469 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:53.656435    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:40:53.670241 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:53.670210    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:40:53.946999 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:53.946963    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:40:55.074859 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:55.074828    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:40:55.088285 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:55.088254    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:40:55.104507 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:55.104477    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:40:55.118542 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:55.118501    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:40:55.398027 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:55.397983    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:40:56.453592 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:56.453556    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:40:56.469454 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:56.469425    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:40:56.482759 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:56.482734    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:40:56.497439 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:56.497409    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:40:56.774251 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:56.774164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:40:57.844236 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:57.844199    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:40:57.862256 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:57.862227    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:40:57.876053 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:57.876027    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:40:57.890839 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:57.890814    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:40:58.180975 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:58.180946    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:40:59.238567 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:59.237900    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:40:59.256893 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:59.256862    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:40:59.270832 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:59.270793    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:40:59.285116 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:59.285079    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:40:59.558312 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:40:59.558222    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:41:00.640488 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:00.640455    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:41:00.659679 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:00.659649    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:41:00.670846 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:00.670809    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:41:00.686235 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:00.686209    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:41:00.962848 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:00.962752    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:41:02.050442 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:02.050408    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:41:02.064001 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:02.063971    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:41:02.077761 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:02.077730    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:41:02.090636 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:02.090608    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:41:02.375591 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:02.372181    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:41:03.479705 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:03.479658    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:41:03.497020 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:03.496988    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:41:03.514750 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:03.514723    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:41:03.530063 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:03.530035    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:41:03.803829 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:03.803730    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:41:04.898369 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:04.898330    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:41:04.913099 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:04.913064    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:41:04.925616 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:04.925592    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:41:04.939715 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:04.939690    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:41:05.214373 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:05.214275    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:41:06.286704 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:06.286672    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:41:06.299799 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:06.299769    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:41:06.318420 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:06.318390    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:41:06.332796 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:06.332771    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:41:06.605390 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:06.605296    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:41:09.172727 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:09.172689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:09.333796 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:09.333758    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:09.423514 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:09.423426    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:12.328227 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:12.328192    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bzwv4_30b8805a-d5a8-4a0f-8334-96625dd051b1/global-pull-secret-syncer/0.log"
Jul 09 18:41:12.434030 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:12.433987    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log"
Jul 09 18:41:12.555822 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:12.555793    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-118.ec2.internal_c36f7378c668aa82a44a3b3d0710dfe6/haproxy/0.log"
Jul 09 18:41:15.566395 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:15.566355    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:15.667348 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:15.667309    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bpw6z_c168d2cf-0c73-4d53-b6f7-c90175455360/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:18.164542 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:18.164499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-czzst_fdfd4f33-5ba4-46fe-8713-553140c2a405/authorino/0.log"
Jul 09 18:41:18.234087 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:18.234051    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-tsj82_00fdfdeb-846a-4fc3-ab85-e6a6cfe556ff/manager/0.log"
Jul 09 18:41:18.299599 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:18.299570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-rc99j_3c47993e-2e31-4c2c-99db-6d6875a95edc/manager/0.log"
Jul 09 18:41:18.360032 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:18.360006    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-rqdm2_c0d63914-3e7a-4b0e-b976-6d9646634f7e/kuadrant-console-plugin/0.log"
Jul 09 18:41:18.681453 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:18.681415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-z679n_da8dd24b-adb8-4c7e-8019-263ed2e14fac/manager/0.log"
Jul 09 18:41:20.471292 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:20.471257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rnn78_c652f783-f4d9-4e3c-a0ec-3ed13c0fe80e/cluster-monitoring-operator/0.log"
Jul 09 18:41:20.694850 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:20.694806    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjnk7_45a39db7-7757-467c-b318-991f4eabd056/node-exporter/0.log"
Jul 09 18:41:20.723780 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:20.723699    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjnk7_45a39db7-7757-467c-b318-991f4eabd056/kube-rbac-proxy/0.log"
Jul 09 18:41:20.749623 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:20.749594    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjnk7_45a39db7-7757-467c-b318-991f4eabd056/init-textfile/0.log"
Jul 09 18:41:22.805148 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:22.805112    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-w5vzg_67897b52-e166-44e1-8b12-ab469929a925/networking-console-plugin/0.log"
Jul 09 18:41:23.390977 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.390939    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"]
Jul 09 18:41:23.391334 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.391321    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97004a0e-b50a-4003-a382-2dd73c9bdb81" containerName="main"
Jul 09 18:41:23.391382 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.391335    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="97004a0e-b50a-4003-a382-2dd73c9bdb81" containerName="main"
Jul 09 18:41:23.391419 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.391395    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="97004a0e-b50a-4003-a382-2dd73c9bdb81" containerName="main"
Jul 09 18:41:23.394514 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.394490    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.396767 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.396749    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xlxbw\"/\"default-dockercfg-wbfr7\""
Jul 09 18:41:23.397473 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.397455    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xlxbw\"/\"openshift-service-ca.crt\""
Jul 09 18:41:23.397581 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.397560    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xlxbw\"/\"kube-root-ca.crt\""
Jul 09 18:41:23.410284 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.410216    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/1.log"
Jul 09 18:41:23.411400 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.411372    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"]
Jul 09 18:41:23.416562 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.416516    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vt7q5_85cf20b4-45ae-412d-9f6b-83163c17afee/console-operator/2.log"
Jul 09 18:41:23.553842 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.553804    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-podres\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.554068 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.553853    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-proc\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.554068 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.553885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-lib-modules\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.554068 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.553995    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6g5z\" (UniqueName: \"kubernetes.io/projected/abd4f88a-718f-495d-a12a-113b14429561-kube-api-access-j6g5z\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.554068 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.554029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-sys\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655381 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655288    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-podres\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655381 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-proc\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655381 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655354    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-lib-modules\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655696 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6g5z\" (UniqueName: \"kubernetes.io/projected/abd4f88a-718f-495d-a12a-113b14429561-kube-api-access-j6g5z\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655696 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655450    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-proc\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655696 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-sys\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655696 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-podres\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655696 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-lib-modules\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.655696 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.655577    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abd4f88a-718f-495d-a12a-113b14429561-sys\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.664439 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.664409    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6g5z\" (UniqueName: \"kubernetes.io/projected/abd4f88a-718f-495d-a12a-113b14429561-kube-api-access-j6g5z\") pod \"perf-node-gather-daemonset-wsxgj\" (UID: \"abd4f88a-718f-495d-a12a-113b14429561\") " pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.705497 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.705458    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:23.860754 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:23.860723    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"]
Jul 09 18:41:23.862447 ip-10-0-141-118 kubenswrapper[2569]: W0709 18:41:23.862415    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podabd4f88a_718f_495d_a12a_113b14429561.slice/crio-e86ac0c3046313666fcaa48e2a89e7422a0e531f2ffb2bed8d0d62134d4ff910 WatchSource:0}: Error finding container e86ac0c3046313666fcaa48e2a89e7422a0e531f2ffb2bed8d0d62134d4ff910: Status 404 returned error can't find the container with id e86ac0c3046313666fcaa48e2a89e7422a0e531f2ffb2bed8d0d62134d4ff910
Jul 09 18:41:24.014564 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:24.014504    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bdf4df5b-jxd89_0ff02642-1a82-42e6-badd-3969351042c8/console/0.log"
Jul 09 18:41:24.064622 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:24.064591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-54pcn_fb09350d-c6ab-44ab-aea7-64ac2bb69914/download-server/0.log"
Jul 09 18:41:24.418164 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:24.418116    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj" event={"ID":"abd4f88a-718f-495d-a12a-113b14429561","Type":"ContainerStarted","Data":"95252055e11d1cd6970708b5a5a8b9b754b4cb63b02f7ba037bb238b95d0d532"}
Jul 09 18:41:24.418379 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:24.418178    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj" event={"ID":"abd4f88a-718f-495d-a12a-113b14429561","Type":"ContainerStarted","Data":"e86ac0c3046313666fcaa48e2a89e7422a0e531f2ffb2bed8d0d62134d4ff910"}
Jul 09 18:41:24.418379 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:24.418273    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:24.456474 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:24.456416    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj" podStartSLOduration=1.456398104 podStartE2EDuration="1.456398104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:24.454039652 +0000 UTC m=+3738.499336163" watchObservedRunningTime="2026-07-09 18:41:24.456398104 +0000 UTC m=+3738.501694651"
Jul 09 18:41:25.920687 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:25.920659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d4dmb_6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a/dns/0.log"
Jul 09 18:41:25.946259 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:25.946225    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d4dmb_6fa2e5ce-d1d2-4674-9e2a-0ed2f7c14e2a/kube-rbac-proxy/0.log"
Jul 09 18:41:26.085879 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:26.085852    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9spw_caf69956-4806-45a0-8f7e-e61a98441332/dns-node-resolver/0.log"
Jul 09 18:41:26.683058 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:26.683021    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdxkr_f8dc5e42-1b09-432e-827b-bd8ab962b3b4/node-ca/0.log"
Jul 09 18:41:28.574414 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:28.574378    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9b99_048c2191-0e89-4fe1-bcef-eb137d8dd186/discovery/0.log"
Jul 09 18:41:28.714143 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:28.714111    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc67f59d-8gfgw_747e8e45-5c52-4275-baa8-3218cdbfb8e8/router/0.log"
Jul 09 18:41:29.307098 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:29.307068    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8qn5m_b929dd4c-b28c-43cc-9362-87d73002435d/serve-healthcheck-canary/0.log"
Jul 09 18:41:29.837097 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:29.837066    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ft7pk_b7db9ab0-1686-44e0-9ad0-5496588b6eca/insights-operator/0.log"
Jul 09 18:41:29.838718 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:29.838683    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ft7pk_b7db9ab0-1686-44e0-9ad0-5496588b6eca/insights-operator/1.log"
Jul 09 18:41:30.013723 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:30.013691    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpv9t_5acadce7-42a4-452f-9ca5-3f80ba7ce707/kube-rbac-proxy/0.log"
Jul 09 18:41:30.038912 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:30.038878    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpv9t_5acadce7-42a4-452f-9ca5-3f80ba7ce707/exporter/0.log"
Jul 09 18:41:30.062089 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:30.062061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpv9t_5acadce7-42a4-452f-9ca5-3f80ba7ce707/extractor/0.log"
Jul 09 18:41:30.433930 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:30.433900    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xlxbw/perf-node-gather-daemonset-wsxgj"
Jul 09 18:41:34.201007 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:34.200903    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6b8548bc6d-7b946_d9e0e2a0-9d99-4c3e-9638-885b1ee62a2d/manager/0.log"
Jul 09 18:41:35.347585 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:35.347553    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-g9kxn_3b359f26-a19e-497f-ab1e-0aa71d097b02/seaweedfs/0.log"
Jul 09 18:41:36.021814 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:36.021722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9b99_048c2191-0e89-4fe1-bcef-eb137d8dd186/discovery/0.log"
Jul 09 18:41:36.148560 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:36.148497    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc67f59d-8gfgw_747e8e45-5c52-4275-baa8-3218cdbfb8e8/router/0.log"
Jul 09 18:41:38.005067 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:38.005026    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9b99_048c2191-0e89-4fe1-bcef-eb137d8dd186/discovery/0.log"
Jul 09 18:41:38.147389 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:38.147362    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc67f59d-8gfgw_747e8e45-5c52-4275-baa8-3218cdbfb8e8/router/0.log"
Jul 09 18:41:41.224935 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:41.224899    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rssm7_8b0a5699-d24e-46c4-bfcf-6db4240b79dc/kube-storage-version-migrator-operator/1.log"
Jul 09 18:41:41.225938 ip-10-0-141-118 kubenswrapper[2569]: I0709 18:41:41.225917    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rssm7_8b0a5699-d24e-46c4-bfcf-6db4240b79dc/kube-storage-version-migrator-operator/0.log"