Jul 09 09:33:41.758456 ip-10-0-128-170 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 09:33:42.269894 ip-10-0-128-170 systemd[1]: Started Kubernetes Kubelet.
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.188766    2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193102    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193113    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193117    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193120    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193124    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193127    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193130    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:33:42.271854 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193133    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193137    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193139    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193142    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193145    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193148    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193150    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193153    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193156    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193158    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193161    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193164    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193166    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193169    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193191    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193194    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193197    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193200    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193203    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193206    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:33:42.273035 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193209    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193212    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193214    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193217    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193219    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193222    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193225    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193227    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193230    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193233    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193235    2585 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193238    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193240    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193243    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193246    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193248    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193251    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193254    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193256    2585 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193259    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193261    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:33:42.274101 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193264    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193266    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193269    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193271    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193274    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193277    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193281    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193284    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193286    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193289    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193292    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193294    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193298    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193302    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193304    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193307    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193309    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193312    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193315    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:33:42.275216 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193318    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193322    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193326    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193329    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193331    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193334    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193337    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193341    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193344    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193346    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193349    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193351    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193355    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193357    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193360    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193362    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193365    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193368    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193371    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:33:42.276260 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193373    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193376    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193379    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193382    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193384    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193387    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193391    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193394    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193397    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193400    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193403    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193406    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.193408    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200443    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200455    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200459    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200462    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200466    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200469    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:33:42.276984 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200472    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200475    2585 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200477    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200480    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200483    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200486    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200489    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200491    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200494    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200497    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200499    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200502    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200504    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200507    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200510    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200513    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200516    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200518    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200522    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:33:42.277615 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200524    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200530    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200534    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200537    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200540    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200542    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200545    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200548    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200551    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200554    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200557    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200559    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200562    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200565    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200567    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200570    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200572    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200575    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200578    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:33:42.278465 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200581    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200583    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200586    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200588    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200591    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200595    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200606    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200609    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200612    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200615    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200618    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200621    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200623    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200626    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200629    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200633    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200635    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200638    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200640    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:33:42.279360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200643    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200646    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200649    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200652    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200654    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200657    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200659    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200662    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200664    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200667    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200670    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200673    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200675    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200679    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200682    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200685    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200688    2585 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200691    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200693    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:33:42.282955 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200695    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200703    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200706    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200708    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200711    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200713    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200716    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200718    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200721    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200723    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200725    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200728    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200731    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200733    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200736    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200739    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.200741    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201154    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201160    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201163    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:33:42.283611 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201165    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201168    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201171    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201192    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201195    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201198    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201201    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201204    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201206    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201209    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201211    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201214    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201217    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201225    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201228    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201231    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201233    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201238    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201241    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:33:42.414112 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201244    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201247    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201251    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201254    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201257    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201259    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201262    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201266    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201269    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201273    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201276    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201278    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201281    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201283    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201286    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201288    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201291    2585 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201293    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201296    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201299    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:33:42.428439 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201302    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201305    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201307    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201309    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201312    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201315    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201317    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201325    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201328    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201331    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201333    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201336    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201338    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201341    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201344    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201347    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201351    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201354    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201356    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201359    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:33:42.429609 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201363    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201365    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201368    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201370    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201373    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201375    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201377    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201380    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201383    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201386    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201388    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201391    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201393    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201396    2585 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201399    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201401    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201404    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201407    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201409    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201412    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:33:42.430498 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201422    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201424    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201427    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201429    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201432    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201434    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201437    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201439    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201443    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201445    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201448    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201450    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201456    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201458    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201461    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201463    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.201466    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201533    2585 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201541    2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201552    2585 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201557    2585 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 09:33:42.431466 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201563    2585 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201566    2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201570    2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201574    2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201577    2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201580    2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201584    2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201587    2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201590    2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201593    2585 flags.go:64] FLAG: --cgroup-root=""
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201595    2585 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201598    2585 flags.go:64] FLAG: --client-ca-file=""
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201607    2585 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201610    2585 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201617    2585 flags.go:64] FLAG: --cluster-domain=""
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201619    2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201623    2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201626    2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201629    2585 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201634    2585 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201637    2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201640    2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201643    2585 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201648    2585 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 09:33:42.432127 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201651    2585 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201653    2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201656    2585 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201659    2585 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201663    2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201666    2585 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201669    2585 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201672    2585 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201675    2585 flags.go:64] FLAG: --enable-server="true"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201678    2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201684    2585 flags.go:64] FLAG: --event-burst="100"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201687    2585 flags.go:64] FLAG: --event-qps="50"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201690    2585 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201693    2585 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201695    2585 flags.go:64] FLAG: --eviction-hard=""
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201699    2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201702    2585 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201705    2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201708    2585 flags.go:64] FLAG: --eviction-soft=""
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201710    2585 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201713    2585 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201721    2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201724    2585 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201727    2585 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201730    2585 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 09:33:42.432826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201733    2585 flags.go:64] FLAG: --feature-gates=""
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201736    2585 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201744    2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201746    2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201749    2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201752    2585 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201757    2585 flags.go:64] FLAG: --help="false"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201759    2585 flags.go:64] FLAG: --hostname-override="ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201763    2585 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201765    2585 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201768    2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201771    2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201775    2585 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201777    2585 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201780    2585 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201783    2585 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201785    2585 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201788    2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201791    2585 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201794    2585 flags.go:64] FLAG: --kube-reserved=""
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201796    2585 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201800    2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201802    2585 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201805    2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 09:33:42.433644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201808    2585 flags.go:64] FLAG: --lock-file=""
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201810    2585 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201813    2585 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201816    2585 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201826    2585 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201834    2585 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201837    2585 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201840    2585 flags.go:64] FLAG: --logging-format="text"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201843    2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201846    2585 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201850    2585 flags.go:64] FLAG: --manifest-url=""
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201853    2585 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201857    2585 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201860    2585 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201865    2585 flags.go:64] FLAG: --max-pods="110"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201868    2585 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201871    2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201873    2585 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201876    2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201879    2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201882    2585 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201885    2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201891    2585 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201894    2585 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201897    2585 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 09:33:42.434321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201900    2585 flags.go:64] FLAG: --pod-cidr=""
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201902    2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201907    2585 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201910    2585 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201913    2585 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201916    2585 flags.go:64] FLAG: --port="10250"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201919    2585 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201922    2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e0eae82b84880b5"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201925    2585 flags.go:64] FLAG: --qos-reserved=""
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201927    2585 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201930    2585 flags.go:64] FLAG: --register-node="true"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201933    2585 flags.go:64] FLAG: --register-with-taints=""
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201936    2585 flags.go:64] FLAG: --registry-burst="10"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201946    2585 flags.go:64] FLAG: --registry-qps="5"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201949    2585 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201952    2585 flags.go:64] FLAG: --reserved-memory=""
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201955    2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201959    2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201962    2585 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201965    2585 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201968    2585 flags.go:64] FLAG: --runonce="false"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201970    2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201974    2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201978    2585 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201980    2585 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 09:33:42.435034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201983    2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201986    2585 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201989    2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201992    2585 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201994    2585 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.201997    2585 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202000    2585 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202002    2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202005    2585 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202008    2585 flags.go:64] FLAG: --system-cgroups=""
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202011    2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202016    2585 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202019    2585 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202022    2585 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202028    2585 flags.go:64] FLAG: --tls-min-version=""
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202031    2585 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202034    2585 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202037    2585 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202039    2585 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202042    2585 flags.go:64] FLAG: --v="2"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202046    2585 flags.go:64] FLAG: --version="false"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202055    2585 flags.go:64] FLAG: --vmodule=""
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202059    2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.202062    2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202222    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:33:42.435712 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202227    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202231    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202234    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202237    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202241    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202245    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202248    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202251    2585 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202255    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202259    2585 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202262    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202265    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202267    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202270    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202272    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202275    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202278    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202280    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202283    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202285    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:33:42.436444 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202288    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202290    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202293    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202295    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202297    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202300    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202302    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202305    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202307    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202311    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202314    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202319    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202322    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202324    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202327    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202329    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202333    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202336    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202338    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202341    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:33:42.436990 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202343    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202347    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202350    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202353    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202356    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202358    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202361    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202364    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202366    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202369    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202371    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202373    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202376    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202378    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202381    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202383    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202386    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202388    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202391    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:33:42.437593 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202393    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202396    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202398    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202401    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202405    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202408    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202411    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202413    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202416    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202419    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202422    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202424    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202427    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202429    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202432    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202434    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202437    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202439    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202442    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202444    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:33:42.438111 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202447    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202449    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202452    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202454    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202457    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202459    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202462    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202466    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202469    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202472    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202475    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202477    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202480    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202483    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202485    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202488    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202492    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202495    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:33:42.438706 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.202497    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.203166    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.209995    2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.210011    2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.210030    2585 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.210035    2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210092    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210097    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210100    2585 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210103    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210106    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210109    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210111    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210114    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210117    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:33:42.439206 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210119    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210122    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210125    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210128    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210130    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210133    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210136    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210139    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210141    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210144    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210146    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210149    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210152    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210154    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210157    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210162    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210166    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210170    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210174    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:33:42.439663 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210201    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210215    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210220    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210225    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210229    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210236    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210241    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210245    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210249    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210252    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210256    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210260    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210264    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210268    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210272    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210276    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210279    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210283    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210287    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:33:42.440169 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210291    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210295    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210299    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210302    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210307    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210311    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210315    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210319    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210323    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210327    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210332    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210336    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210339    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210344    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210348    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210353    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210356    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210361    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210366    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210369    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:33:42.440801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210374    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210377    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210381    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210385    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210388    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210392    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210396    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210399    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210403    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210407    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210411    2585 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210416    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210422    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210425    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210429    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210433    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210437    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210441    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210445    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210450    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:33:42.441659 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210454    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210457    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210462    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210465    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210470    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210474    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210478    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210482    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210486    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210490    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210495    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210500    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.210506    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210661    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 09:33:42.442459 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210666    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210670    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210675    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210680    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210684    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210688    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210691    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210695    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210699    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210703    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210706    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210711    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210714    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210718    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210721    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210725    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210729    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210733    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210736    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 09:33:42.591404 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210740    2585 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210745    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210749    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210752    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210756    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210760    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210764    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210768    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210773    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210776    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210782    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210786    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210790    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210794    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210798    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210802    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210806    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210810    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210813    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210817    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 09:33:42.592687 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210820    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210824    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210828    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210832    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210835    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210840    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210843    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210847    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210851    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210855    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210859    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210863    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210867    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210875    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210878    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210880    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210884    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210887    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210891    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210894    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 09:33:42.593363 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210898    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210903    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210908    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210912    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210916    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210922    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210926    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210929    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210933    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210937    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210941    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210945    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210950    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210955    2585 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210959    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210963    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210966    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210970    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210974    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 09:33:42.593995 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210977    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210981    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210984    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210988    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210992    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.210996    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211000    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211004    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211008    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211011    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211015    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211019    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211022    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211026    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211030    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211037    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211041    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211045    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211049    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 09:33:42.594571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:42.211053    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.211060    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.211229    2585 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.213410    2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.215015    2585 server.go:1019] "Starting client certificate rotation"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.215119    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.215149    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.217615    2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.220707    2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.233208    2585 log.go:25] "Validated CRI v1 runtime API"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.235254    2585 log.go:25] "Validated CRI v1 image API"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.239780    2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 09:33:42.595142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.242339    2585 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e164b62c-e2a0-4c4f-bde0-6ac7d7f5fc12:/dev/nvme0n1p4 f8efa9e5-ec3e-49b8-82f9-aa805f8d4e8b:/dev/nvme0n1p3]
Jul 09 09:33:42.595548 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.242355    2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 09:33:42.595548 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.244638    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.248568    2585 manager.go:216] Machine: {Timestamp:2026-07-09 09:33:42.247238927 +0000 UTC m=+0.365598752 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099990 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260f424ec141d745acfb244c3a6227 SystemUUID:ec260f42-4ec1-41d7-45ac-fb244c3a6227 BootID:bd4cf2c5-44b9-4095-90c5-af0b295d79d5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:9c:d4:60:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:9c:d4:60:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:2d:56:1c:b9:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.248667    2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.248778    2585 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.251995    2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.252021    2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-170.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.253385    2585 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.253396    2585 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.253408    2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.254137    2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.255449    2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.258536    2585 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.258658    2585 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.258687    2585 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.258700    2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.258723    2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.258736    2585 kubelet.go:398] "Adding apiserver pod source"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.258748    2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 09:33:42.595727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.259151    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.259166    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.261389    2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.263209    2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.263236    2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264262    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264274    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264283    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264289    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264298    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264303    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264310    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264316    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264323    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264329    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264337    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.264343    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.265200    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.265206    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.268669    2585 server.go:1268] "Started kubelet"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.268752    2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.268827    2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.268901    2585 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.270646    2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.272172    2585 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.273907    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb79r"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.278580    2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.278605    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.278797    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.279193    2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.279195    2585 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.279218    2585 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.279320    2585 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.279329    2585 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285004    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb79r"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285150    2585 factory.go:55] Registering systemd factory
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285165    2585 factory.go:223] Registration of the systemd container factory successfully
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285433    2585 factory.go:153] Registering CRI-O factory
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285449    2585 factory.go:223] Registration of the crio container factory successfully
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.285430    2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285508    2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285531    2585 factory.go:103] Registering Raw factory
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285548    2585 manager.go:1196] Started watching for new ooms in manager
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.285662    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.285788    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.285818    2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-170.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 09:33:42.596353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.286117    2585 manager.go:349] Starting recovery of all containers
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.287534    2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.287621    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.285622    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-170.ec2.internal.18c0954fc4653564  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-170.ec2.internal,UID:ip-10-0-128-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-170.ec2.internal,},FirstTimestamp:2026-07-09 09:33:42.268638564 +0000 UTC m=+0.386998388,LastTimestamp:2026-07-09 09:33:42.268638564 +0000 UTC m=+0.386998388,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-170.ec2.internal,}"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.295905    2585 manager.go:354] Recovery completed
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.304922    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.306799    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.306822    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.306831    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.307312    2585 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.307320    2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.307335    2585 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.307372    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.308076    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.308103    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.308117    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.308467    2585 policy_none.go:49] "None policy: Start"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.308482    2585 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.308494    2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.309587    2585 policy_none.go:47] "Start"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.356810    2585 manager.go:337] "Starting Device Plugin manager"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.356990    2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.357004    2585 server.go:87] "Starting device plugin registration server"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.357249    2585 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.357259    2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.357350    2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.357435    2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.357443    2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.357859    2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.357905    2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.458076    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.464292    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.464325    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.464338    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.464365    2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.465306    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.466524    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.466558    2585 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.466579    2585 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.466613    2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 09:33:42.597699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.468376    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.471965    2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.471982    2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-170.ec2.internal\": node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.514298    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.566801    2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal"]
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.566884    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.576405    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.576434    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.576445    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.577965    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.578140    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.578170    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.579125    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.579152    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.579159    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.579172    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.579175    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.579186    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.580428    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23a151c531fccc836288ce0dea3b0149-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal\" (UID: \"23a151c531fccc836288ce0dea3b0149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.580451    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23a151c531fccc836288ce0dea3b0149-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal\" (UID: \"23a151c531fccc836288ce0dea3b0149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.580469    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8937e12f98485ce07bb67269f2903696-config\") pod \"kube-apiserver-proxy-ip-10-0-128-170.ec2.internal\" (UID: \"8937e12f98485ce07bb67269f2903696\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.580432    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.580505    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.581350    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.581379    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 09:33:42.598926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.581396    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeHasSufficientPID"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.614407    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.616085    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-170.ec2.internal\" not found" node="ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.621131    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-170.ec2.internal\" not found" node="ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.681533    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23a151c531fccc836288ce0dea3b0149-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal\" (UID: \"23a151c531fccc836288ce0dea3b0149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.681557    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8937e12f98485ce07bb67269f2903696-config\") pod \"kube-apiserver-proxy-ip-10-0-128-170.ec2.internal\" (UID: \"8937e12f98485ce07bb67269f2903696\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.681574    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23a151c531fccc836288ce0dea3b0149-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal\" (UID: \"23a151c531fccc836288ce0dea3b0149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.681627    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23a151c531fccc836288ce0dea3b0149-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal\" (UID: \"23a151c531fccc836288ce0dea3b0149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.681644    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23a151c531fccc836288ce0dea3b0149-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal\" (UID: \"23a151c531fccc836288ce0dea3b0149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.681652    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8937e12f98485ce07bb67269f2903696-config\") pod \"kube-apiserver-proxy-ip-10-0-128-170.ec2.internal\" (UID: \"8937e12f98485ce07bb67269f2903696\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:42.749238 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.715295    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:42.886914 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.817453    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.018557 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:42.919572    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.018557 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.920750    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:43.018557 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:42.925440    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:43.022139 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.020674    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.145060 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.120783    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.284690 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.215361    2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 09:33:43.284690 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.215500    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 09:33:43.284690 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.222607    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.286951 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.286647    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 09:28:43 +0000 UTC" deadline="2028-02-28 12:42:44.18121649 +0000 UTC"
Jul 09 09:33:43.286951 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.286691    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14379h9m0.894530589s"
Jul 09 09:33:43.414652 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.323778    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.428834 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.424313    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.542223 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.525275    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.671889 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.625826    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.799606 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:43.726821    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-170.ec2.internal\" not found"
Jul 09 09:33:43.799606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.766489    2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:33:43.799606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.769346    2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:33:43.799606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.772876    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:33:43.799606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.779019    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:43.799606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.791848    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 09:33:43.799606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.793201    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal"
Jul 09 09:33:43.900519 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:43.805458    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 09:33:44.192801 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.192767    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a151c531fccc836288ce0dea3b0149.slice/crio-2bcecfc60b2431c3b94d5a92668a805b7cd83bf98197974cfc48e48a647239c7 WatchSource:0}: Error finding container 2bcecfc60b2431c3b94d5a92668a805b7cd83bf98197974cfc48e48a647239c7: Status 404 returned error can't find the container with id 2bcecfc60b2431c3b94d5a92668a805b7cd83bf98197974cfc48e48a647239c7
Jul 09 09:33:44.193405 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.193385    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8937e12f98485ce07bb67269f2903696.slice/crio-a5b57d22b8333d7ae6fc10266db6a3b3547a58c6db2f204abc003f97c67d0ea8 WatchSource:0}: Error finding container a5b57d22b8333d7ae6fc10266db6a3b3547a58c6db2f204abc003f97c67d0ea8: Status 404 returned error can't find the container with id a5b57d22b8333d7ae6fc10266db6a3b3547a58c6db2f204abc003f97c67d0ea8
Jul 09 09:33:44.198126 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.198108    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 09:33:44.260098 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.260075    2585 apiserver.go:52] "Watching apiserver"
Jul 09 09:33:44.267449 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.267433    2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 09:33:44.269626 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.268391    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal","openshift-multus/network-metrics-daemon-nvq9w","openshift-network-diagnostics/network-check-target-v5t9z","openshift-ovn-kubernetes/ovnkube-node-4jtwj","kube-system/global-pull-secret-syncer-skqw5","kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal","openshift-image-registry/node-ca-8wthl","openshift-multus/multus-additional-cni-plugins-8jdfh","openshift-multus/multus-b9jth","openshift-network-operator/iptables-alerter-kbfl4","kube-system/konnectivity-agent-h2n7j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899","openshift-cluster-node-tuning-operator/tuned-7jfvb","openshift-dns/node-resolver-z8fr5"]
Jul 09 09:33:44.271015 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.270950    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.272031 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.272012    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.273098 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.273082    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:44.273178 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.273161    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:44.273538 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.273522    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9vhdz\""
Jul 09 09:33:44.273538 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.273527    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 09:33:44.273677 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.273529    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 09:33:44.273814 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.273798    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 09:33:44.274321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.274300    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.274763 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.274328    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:44.274763 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.274443    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mglgr\""
Jul 09 09:33:44.274763 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.274470    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 09:33:44.275575 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.275561    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.275635 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.275621    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:44.276839 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.276817    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.278123 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.278105    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.278413 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.278392    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 09:33:44.278513 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.278461    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 09:33:44.279343 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.279323    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 09:33:44.279426 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.279362    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.280542 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.280523    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 09:33:44.280687 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.280671    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:44.280794 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.280771    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:44.280918 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.280883    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 09:33:44.281009 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.280919    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cshn4\""
Jul 09 09:33:44.281009 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.280950    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 09:33:44.281322 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281302    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 09:33:44.281460 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281398    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 09:33:44.281460 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281451    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 09:33:44.281599 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281479    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 09:33:44.281599 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281479    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 09:33:44.281695 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281678    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 09:33:44.281774 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281759    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kms9d\""
Jul 09 09:33:44.281846 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281823    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 09:33:44.281846 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281836    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 09:33:44.281976 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281824    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xxt2g\""
Jul 09 09:33:44.281976 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281887    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 09:33:44.282084 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.281994    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wq74z\""
Jul 09 09:33:44.282173 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.282160    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.283675 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.283657    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.284866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.284848    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.289846 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.289796    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:33:44.289939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.289865    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 09:33:44.289939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.289881    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 09:33:44.290057 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.289945    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b6h9\""
Jul 09 09:33:44.290057 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.289952    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fn48m\""
Jul 09 09:33:44.290057 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.289883    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 09:33:44.290057 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.289946    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k8c2g\""
Jul 09 09:33:44.290218 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290205    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 09:33:44.290300 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290281    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 09:33:44.290300 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290296    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 09:33:44.290409 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290324    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 09:33:44.290568 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290553    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-env-overrides\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.290615 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290577    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-k8s-cni-cncf-io\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.290615 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290595    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysctl-conf\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.290697 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290618    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-os-release\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.290697 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290642    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.290787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290699    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:44.290787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290722    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-systemd\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.290787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290738    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-os-release\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.290787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290755    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-cni-bin\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.290954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290796    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-multus-certs\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.290954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290831    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.290954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290854    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-lib-modules\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.290954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290870    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-ovn\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.290954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290884    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-node-log\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.290954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290903    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-var-lib-kubelet\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.290954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290944    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7239d49-2a5a-43dd-ba67-ccb7535bd293-hosts-file\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.290983    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/24e6c876-35de-40d7-9aa9-89577ef79ea7-serviceca\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291010    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-run-netns\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291035    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-hostroot\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291061    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291087    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-sys\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291110    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-conf-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291133    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-etc-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291158    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-ovnkube-config\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291182    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-cnibin\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291224    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-netns\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291251    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cni-binary-copy\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.291320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291273    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-kubernetes\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291321    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f014bc1-a21f-421c-95fc-a54798192207-tmp\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291356    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-etc-kubernetes\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291388    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cnibin\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291413    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qhhc\" (UniqueName: \"kubernetes.io/projected/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-kube-api-access-8qhhc\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291439    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-systemd\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291477    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f014bc1-a21f-421c-95fc-a54798192207-etc-tuned\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-slash\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291553    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291590    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebcd178a-b784-413e-9ace-21252e141ddc-multus-daemon-config\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291615    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-modprobe-d\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291639    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-host\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291664    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-kubelet\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291686    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-systemd-units\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291751    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.291866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291787    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebcd178a-b784-413e-9ace-21252e141ddc-cni-binary-copy\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291831    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysctl-d\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291889    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-run\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291939    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6mxv\" (UniqueName: \"kubernetes.io/projected/294a299b-397e-431f-bc41-2e95b263e091-kube-api-access-r6mxv\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291967    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-ovnkube-script-lib\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.291995    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-system-cni-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292056    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-socket-dir-parent\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292078    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7528\" (UniqueName: \"kubernetes.io/projected/9f014bc1-a21f-421c-95fc-a54798192207-kube-api-access-z7528\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292108    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-var-lib-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292131    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-log-socket\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292155    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b2f1a17-546c-4814-be44-ae594f9a1752-kubelet-config\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292181    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-cni-multus\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292205    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7239d49-2a5a-43dd-ba67-ccb7535bd293-tmp-dir\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292248    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292272    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24e6c876-35de-40d7-9aa9-89577ef79ea7-host\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292310    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/c3fff5db-218c-40db-b781-06820aaee71c-kube-api-access-p2kpj\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.292482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292336    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b2f1a17-546c-4814-be44-ae594f9a1752-dbus\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292360    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqt6h\" (UniqueName: \"kubernetes.io/projected/ebcd178a-b784-413e-9ace-21252e141ddc-kube-api-access-lqt6h\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292383    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-system-cni-dir\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292412    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rg7n\" (UniqueName: \"kubernetes.io/projected/24e6c876-35de-40d7-9aa9-89577ef79ea7-kube-api-access-5rg7n\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292451    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-cni-netd\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3fff5db-218c-40db-b781-06820aaee71c-ovn-node-metrics-cert\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292534    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-kubelet\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292569    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysconfig\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292591    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b5qz\" (UniqueName: \"kubernetes.io/projected/f7239d49-2a5a-43dd-ba67-ccb7535bd293-kube-api-access-5b5qz\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292616    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292639    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-cni-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.293038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.292663    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-cni-bin\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.297344 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.297324    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 09:33:44.324713 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.324689    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdzdh"
Jul 09 09:33:44.334410 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.334393    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdzdh"
Jul 09 09:33:44.379883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.379853    2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 09:33:44.386660 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.386645    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 09:33:44.392808 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392789    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-os-release\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.392883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392818    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.392883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392840    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:44.392883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392857    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-systemd\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.392883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392872    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-os-release\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392889    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-cni-bin\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392904    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-multus-certs\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392939    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-systemd\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392947    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392978    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-cni-bin\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392988    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-lib-modules\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.392992    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-os-release\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393025    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-multus-certs\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393043    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-ovn\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393069    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-node-log\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.393077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393045    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-os-release\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393096    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-var-lib-kubelet\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393115    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-node-log\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393122    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7239d49-2a5a-43dd-ba67-ccb7535bd293-hosts-file\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393107    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-ovn\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393157    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1df4c6e-941b-43fd-b31b-3844983066c2-host-slash\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393133    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393171    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-var-lib-kubelet\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393179    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9dg\" (UniqueName: \"kubernetes.io/projected/d1df4c6e-941b-43fd-b31b-3844983066c2-kube-api-access-hp9dg\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393199    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f7239d49-2a5a-43dd-ba67-ccb7535bd293-hosts-file\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393120    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-lib-modules\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393278    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-sys-fs\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393296    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/24e6c876-35de-40d7-9aa9-89577ef79ea7-serviceca\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393318    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-run-netns\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393349    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-hostroot\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393369    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.393639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393374    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-run-netns\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393398    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-hostroot\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393421    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-sys\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393438    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-conf-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393457    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd6084d8-d2de-482b-acdf-695e4c610731-konnectivity-ca\") pod \"konnectivity-agent-h2n7j\" (UID: \"cd6084d8-d2de-482b-acdf-695e4c610731\") " pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393473    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393490    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-etc-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393537    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-ovnkube-config\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393555    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-cnibin\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393565    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-etc-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393566    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-sys\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393571    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-netns\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393535    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-conf-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393582    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393601    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-netns\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393638    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cni-binary-copy\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393647    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-cnibin\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393686    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-kubernetes\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.394523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393712    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f014bc1-a21f-421c-95fc-a54798192207-tmp\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393735    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-etc-kubernetes\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393744    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/24e6c876-35de-40d7-9aa9-89577ef79ea7-serviceca\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393752    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cnibin\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393748    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-kubernetes\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393776    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qhhc\" (UniqueName: \"kubernetes.io/projected/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-kube-api-access-8qhhc\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393802    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-systemd\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393803    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-etc-kubernetes\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393816    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cnibin\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393863    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-systemd\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393876    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393961    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f014bc1-a21f-421c-95fc-a54798192207-etc-tuned\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.393986    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-registration-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394009    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-device-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394027    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-slash\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394043    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394067    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebcd178a-b784-413e-9ace-21252e141ddc-multus-daemon-config\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.395280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394109    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-slash\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394116    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394117    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-modprobe-d\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394154    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-cni-binary-copy\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394160    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-ovnkube-config\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394172    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-host\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394066    2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394240    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-host\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394251    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-modprobe-d\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394272    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-kubelet\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394301    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394330    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd6084d8-d2de-482b-acdf-695e4c610731-agent-certs\") pod \"konnectivity-agent-h2n7j\" (UID: \"cd6084d8-d2de-482b-acdf-695e4c610731\") " pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394352    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-kubelet\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394356    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-systemd-units\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394400    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-systemd-units\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.394420    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394412    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394471    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebcd178a-b784-413e-9ace-21252e141ddc-cni-binary-copy\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.396112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394499    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysctl-d\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394525    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-run\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394574    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6mxv\" (UniqueName: \"kubernetes.io/projected/294a299b-397e-431f-bc41-2e95b263e091-kube-api-access-r6mxv\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394602    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-ovnkube-script-lib\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394643    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebcd178a-b784-413e-9ace-21252e141ddc-multus-daemon-config\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394627    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-system-cni-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.394654    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret podName:6b2f1a17-546c-4814-be44-ae594f9a1752 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:44.894633757 +0000 UTC m=+3.012993568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret") pod "global-pull-secret-syncer-skqw5" (UID: "6b2f1a17-546c-4814-be44-ae594f9a1752") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394680    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-run-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394700    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-socket-dir-parent\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394709    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-system-cni-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394728    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7528\" (UniqueName: \"kubernetes.io/projected/9f014bc1-a21f-421c-95fc-a54798192207-kube-api-access-z7528\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394756    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-var-lib-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394781    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-log-socket\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394806    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b2f1a17-546c-4814-be44-ae594f9a1752-kubelet-config\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394837    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-log-socket\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394857    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b2f1a17-546c-4814-be44-ae594f9a1752-kubelet-config\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394867    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-cni-multus\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.396984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394896    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7239d49-2a5a-43dd-ba67-ccb7535bd293-tmp-dir\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394920    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394940    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24e6c876-35de-40d7-9aa9-89577ef79ea7-host\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394960    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/c3fff5db-218c-40db-b781-06820aaee71c-kube-api-access-p2kpj\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394971    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-socket-dir-parent\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394982    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b2f1a17-546c-4814-be44-ae594f9a1752-dbus\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395011    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqt6h\" (UniqueName: \"kubernetes.io/projected/ebcd178a-b784-413e-9ace-21252e141ddc-kube-api-access-lqt6h\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395040    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-system-cni-dir\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395059    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b2f1a17-546c-4814-be44-ae594f9a1752-dbus\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395071    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npcdt\" (UniqueName: \"kubernetes.io/projected/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-kube-api-access-npcdt\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395078    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-run\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395094    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-var-lib-openvswitch\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395101    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rg7n\" (UniqueName: \"kubernetes.io/projected/24e6c876-35de-40d7-9aa9-89577ef79ea7-kube-api-access-5rg7n\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395125    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-cni-multus\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395134    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebcd178a-b784-413e-9ace-21252e141ddc-cni-binary-copy\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395168    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-cni-netd\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.394782    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysctl-d\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.397931 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.395204    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.395252    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs podName:294a299b-397e-431f-bc41-2e95b263e091 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:44.895226189 +0000 UTC m=+3.013586000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs") pod "network-metrics-daemon-nvq9w" (UID: "294a299b-397e-431f-bc41-2e95b263e091") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395281    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24e6c876-35de-40d7-9aa9-89577ef79ea7-host\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395128    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-cni-netd\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395452    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-system-cni-dir\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395409    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7239d49-2a5a-43dd-ba67-ccb7535bd293-tmp-dir\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395445    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3fff5db-218c-40db-b781-06820aaee71c-ovn-node-metrics-cert\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395572    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-kubelet\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395592    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysconfig\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395629    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b5qz\" (UniqueName: \"kubernetes.io/projected/f7239d49-2a5a-43dd-ba67-ccb7535bd293-kube-api-access-5b5qz\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395646    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395661    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-cni-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395669    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-ovnkube-script-lib\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395716    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1df4c6e-941b-43fd-b31b-3844983066c2-iptables-alerter-script\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395723    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysconfig\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395753    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-cni-bin\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395766    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-var-lib-kubelet\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.398465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395778    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-env-overrides\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395853    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-multus-cni-dir\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395910    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-cni-bin\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395915    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-k8s-cni-cncf-io\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395931    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3fff5db-218c-40db-b781-06820aaee71c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395971    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysctl-conf\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.395991    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-socket-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.396006    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebcd178a-b784-413e-9ace-21252e141ddc-host-run-k8s-cni-cncf-io\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.396104    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f014bc1-a21f-421c-95fc-a54798192207-etc-sysctl-conf\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.396336    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3fff5db-218c-40db-b781-06820aaee71c-env-overrides\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.397972    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f014bc1-a21f-421c-95fc-a54798192207-etc-tuned\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.398031    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3fff5db-218c-40db-b781-06820aaee71c-ovn-node-metrics-cert\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.398960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.398040    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f014bc1-a21f-421c-95fc-a54798192207-tmp\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.399675 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.399657    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:33:44.399711 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.399680    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:33:44.399711 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.399689    2585 projected.go:196] Error preparing data for projected volume kube-api-access-gdcr7 for pod openshift-network-diagnostics/network-check-target-v5t9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:44.399777 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.399738    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7 podName:5c104045-fe61-4062-abbd-10c3fd4866d7 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:44.89972715 +0000 UTC m=+3.018086965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gdcr7" (UniqueName: "kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7") pod "network-check-target-v5t9z" (UID: "5c104045-fe61-4062-abbd-10c3fd4866d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:44.410958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.410930    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qhhc\" (UniqueName: \"kubernetes.io/projected/de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10-kube-api-access-8qhhc\") pod \"multus-additional-cni-plugins-8jdfh\" (UID: \"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10\") " pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.413084 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.413055    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b5qz\" (UniqueName: \"kubernetes.io/projected/f7239d49-2a5a-43dd-ba67-ccb7535bd293-kube-api-access-5b5qz\") pod \"node-resolver-z8fr5\" (UID: \"f7239d49-2a5a-43dd-ba67-ccb7535bd293\") " pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.415537 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.415510    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/c3fff5db-218c-40db-b781-06820aaee71c-kube-api-access-p2kpj\") pod \"ovnkube-node-4jtwj\" (UID: \"c3fff5db-218c-40db-b781-06820aaee71c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.415678 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.415653    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6mxv\" (UniqueName: \"kubernetes.io/projected/294a299b-397e-431f-bc41-2e95b263e091-kube-api-access-r6mxv\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:44.415733 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.415669    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rg7n\" (UniqueName: \"kubernetes.io/projected/24e6c876-35de-40d7-9aa9-89577ef79ea7-kube-api-access-5rg7n\") pod \"node-ca-8wthl\" (UID: \"24e6c876-35de-40d7-9aa9-89577ef79ea7\") " pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.416186 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.416166    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7528\" (UniqueName: \"kubernetes.io/projected/9f014bc1-a21f-421c-95fc-a54798192207-kube-api-access-z7528\") pod \"tuned-7jfvb\" (UID: \"9f014bc1-a21f-421c-95fc-a54798192207\") " pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.417581 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.417564    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqt6h\" (UniqueName: \"kubernetes.io/projected/ebcd178a-b784-413e-9ace-21252e141ddc-kube-api-access-lqt6h\") pod \"multus-b9jth\" (UID: \"ebcd178a-b784-413e-9ace-21252e141ddc\") " pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.470466 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.470427    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal" event={"ID":"8937e12f98485ce07bb67269f2903696","Type":"ContainerStarted","Data":"a5b57d22b8333d7ae6fc10266db6a3b3547a58c6db2f204abc003f97c67d0ea8"}
Jul 09 09:33:44.471655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.471627    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal" event={"ID":"23a151c531fccc836288ce0dea3b0149","Type":"ContainerStarted","Data":"2bcecfc60b2431c3b94d5a92668a805b7cd83bf98197974cfc48e48a647239c7"}
Jul 09 09:33:44.496506 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496484    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1df4c6e-941b-43fd-b31b-3844983066c2-iptables-alerter-script\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.496627 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496523    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-socket-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496627 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496570    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1df4c6e-941b-43fd-b31b-3844983066c2-host-slash\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.496627 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496596    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9dg\" (UniqueName: \"kubernetes.io/projected/d1df4c6e-941b-43fd-b31b-3844983066c2-kube-api-access-hp9dg\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.496627 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496620    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496644    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-sys-fs\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496657    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1df4c6e-941b-43fd-b31b-3844983066c2-host-slash\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496675    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd6084d8-d2de-482b-acdf-695e4c610731-konnectivity-ca\") pod \"konnectivity-agent-h2n7j\" (UID: \"cd6084d8-d2de-482b-acdf-695e4c610731\") " pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496701    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-socket-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496713    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496742    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-sys-fs\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496759    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496777    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-registration-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.496847 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496795    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.497365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496882    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-device-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.497365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496929    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-registration-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.497365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.496995    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-device-dir\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.497365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.497016    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd6084d8-d2de-482b-acdf-695e4c610731-agent-certs\") pod \"konnectivity-agent-h2n7j\" (UID: \"cd6084d8-d2de-482b-acdf-695e4c610731\") " pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.497365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.497066    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1df4c6e-941b-43fd-b31b-3844983066c2-iptables-alerter-script\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.497365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.497074    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npcdt\" (UniqueName: \"kubernetes.io/projected/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-kube-api-access-npcdt\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.497365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.497354    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd6084d8-d2de-482b-acdf-695e4c610731-konnectivity-ca\") pod \"konnectivity-agent-h2n7j\" (UID: \"cd6084d8-d2de-482b-acdf-695e4c610731\") " pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.499181 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.499166    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd6084d8-d2de-482b-acdf-695e4c610731-agent-certs\") pod \"konnectivity-agent-h2n7j\" (UID: \"cd6084d8-d2de-482b-acdf-695e4c610731\") " pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.504650 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.504630    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9dg\" (UniqueName: \"kubernetes.io/projected/d1df4c6e-941b-43fd-b31b-3844983066c2-kube-api-access-hp9dg\") pod \"iptables-alerter-kbfl4\" (UID: \"d1df4c6e-941b-43fd-b31b-3844983066c2\") " pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.504904 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.504888    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npcdt\" (UniqueName: \"kubernetes.io/projected/4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b-kube-api-access-npcdt\") pod \"aws-ebs-csi-driver-node-zq899\" (UID: \"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.585485 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.585423    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8wthl"
Jul 09 09:33:44.587970 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.587952    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7jfvb"
Jul 09 09:33:44.595227 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.595194    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e6c876_35de_40d7_9aa9_89577ef79ea7.slice/crio-2657ec73f13f947f42e3991c8794e69cd22900ba5631dcaf53e2e72fa46952ec WatchSource:0}: Error finding container 2657ec73f13f947f42e3991c8794e69cd22900ba5631dcaf53e2e72fa46952ec: Status 404 returned error can't find the container with id 2657ec73f13f947f42e3991c8794e69cd22900ba5631dcaf53e2e72fa46952ec
Jul 09 09:33:44.596661 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.596645    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:33:44.597279 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.597256    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f014bc1_a21f_421c_95fc_a54798192207.slice/crio-49e1ef942fbb77ca953edb010e271dd9e7e7a0ef447c567bcc7890fb7cc8e897 WatchSource:0}: Error finding container 49e1ef942fbb77ca953edb010e271dd9e7e7a0ef447c567bcc7890fb7cc8e897: Status 404 returned error can't find the container with id 49e1ef942fbb77ca953edb010e271dd9e7e7a0ef447c567bcc7890fb7cc8e897
Jul 09 09:33:44.602195 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.602179    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z8fr5"
Jul 09 09:33:44.605616 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.605592    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fff5db_218c_40db_b781_06820aaee71c.slice/crio-73e457927060d62396685fcdcaffb6e2a67a79dc21162be7009839a50e3c75f4 WatchSource:0}: Error finding container 73e457927060d62396685fcdcaffb6e2a67a79dc21162be7009839a50e3c75f4: Status 404 returned error can't find the container with id 73e457927060d62396685fcdcaffb6e2a67a79dc21162be7009839a50e3c75f4
Jul 09 09:33:44.607583 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.607566    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b9jth"
Jul 09 09:33:44.610209 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.610173    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7239d49_2a5a_43dd_ba67_ccb7535bd293.slice/crio-be9b96183c960ff9ba24ff2960f050bdd9b01c930a78563da3dd6c13ab271c12 WatchSource:0}: Error finding container be9b96183c960ff9ba24ff2960f050bdd9b01c930a78563da3dd6c13ab271c12: Status 404 returned error can't find the container with id be9b96183c960ff9ba24ff2960f050bdd9b01c930a78563da3dd6c13ab271c12
Jul 09 09:33:44.614380 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.614361    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8jdfh"
Jul 09 09:33:44.618421 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.618234    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcd178a_b784_413e_9ace_21252e141ddc.slice/crio-179f939b67fc8cb9ce997145611d0f833511d331158c40c2cf1b7344ef7e260b WatchSource:0}: Error finding container 179f939b67fc8cb9ce997145611d0f833511d331158c40c2cf1b7344ef7e260b: Status 404 returned error can't find the container with id 179f939b67fc8cb9ce997145611d0f833511d331158c40c2cf1b7344ef7e260b
Jul 09 09:33:44.620798 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.620749    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbfl4"
Jul 09 09:33:44.624311 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.624287    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9ac9bd_f3e0_40f4_99ff_a285dcfb9c10.slice/crio-739a6c7bd567b1301b04ac4c591f4ea8e8d24178536780a78352418e6a94004c WatchSource:0}: Error finding container 739a6c7bd567b1301b04ac4c591f4ea8e8d24178536780a78352418e6a94004c: Status 404 returned error can't find the container with id 739a6c7bd567b1301b04ac4c591f4ea8e8d24178536780a78352418e6a94004c
Jul 09 09:33:44.625532 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.625513    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:33:44.629993 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.629973    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1df4c6e_941b_43fd_b31b_3844983066c2.slice/crio-c42e2dc31f7c92ee89312f22777a557d043125b34745fa2c706a485bedccbf05 WatchSource:0}: Error finding container c42e2dc31f7c92ee89312f22777a557d043125b34745fa2c706a485bedccbf05: Status 404 returned error can't find the container with id c42e2dc31f7c92ee89312f22777a557d043125b34745fa2c706a485bedccbf05
Jul 09 09:33:44.630725 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.630710    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899"
Jul 09 09:33:44.635189 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.635170    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6084d8_d2de_482b_acdf_695e4c610731.slice/crio-4ba0f002b306bf253a0aa57d6589a5e999207a924240e365b6ad095da0c5a30a WatchSource:0}: Error finding container 4ba0f002b306bf253a0aa57d6589a5e999207a924240e365b6ad095da0c5a30a: Status 404 returned error can't find the container with id 4ba0f002b306bf253a0aa57d6589a5e999207a924240e365b6ad095da0c5a30a
Jul 09 09:33:44.639977 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:33:44.639957    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c91c6d2_8c62_4f1b_a3ce_5de55d57b72b.slice/crio-f626853dafcbf3971dce44f53d606041937bd0f969ce9ebb28b49049ec87bfd4 WatchSource:0}: Error finding container f626853dafcbf3971dce44f53d606041937bd0f969ce9ebb28b49049ec87bfd4: Status 404 returned error can't find the container with id f626853dafcbf3971dce44f53d606041937bd0f969ce9ebb28b49049ec87bfd4
Jul 09 09:33:44.900113 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.900022    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:44.900113 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.900101    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:44.900383 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:44.900141    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:44.900447 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.900385    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:33:44.900447 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.900407    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:33:44.900447 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.900421    2585 projected.go:196] Error preparing data for projected volume kube-api-access-gdcr7 for pod openshift-network-diagnostics/network-check-target-v5t9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:44.900596 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.900482    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7 podName:5c104045-fe61-4062-abbd-10c3fd4866d7 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:45.900462578 +0000 UTC m=+4.018822394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdcr7" (UniqueName: "kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7") pod "network-check-target-v5t9z" (UID: "5c104045-fe61-4062-abbd-10c3fd4866d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:44.901049 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.901018    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:44.901261 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.901076    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret podName:6b2f1a17-546c-4814-be44-ae594f9a1752 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:45.901057424 +0000 UTC m=+4.019417238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret") pod "global-pull-secret-syncer-skqw5" (UID: "6b2f1a17-546c-4814-be44-ae594f9a1752") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:44.901261 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.901139    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:44.901261 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:44.901181    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs podName:294a299b-397e-431f-bc41-2e95b263e091 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:45.901167559 +0000 UTC m=+4.019527380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs") pod "network-metrics-daemon-nvq9w" (UID: "294a299b-397e-431f-bc41-2e95b263e091") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:45.336486 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.336392    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 09:28:44 +0000 UTC" deadline="2027-12-16 09:16:19.87754601 +0000 UTC"
Jul 09 09:33:45.336486 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.336435    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12599h42m34.541116542s"
Jul 09 09:33:45.467750 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.467717    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:45.467924 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.467858    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:45.504282 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.504230    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2n7j" event={"ID":"cd6084d8-d2de-482b-acdf-695e4c610731","Type":"ContainerStarted","Data":"4ba0f002b306bf253a0aa57d6589a5e999207a924240e365b6ad095da0c5a30a"}
Jul 09 09:33:45.510109 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.510077    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbfl4" event={"ID":"d1df4c6e-941b-43fd-b31b-3844983066c2","Type":"ContainerStarted","Data":"c42e2dc31f7c92ee89312f22777a557d043125b34745fa2c706a485bedccbf05"}
Jul 09 09:33:45.530217 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.530184    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerStarted","Data":"739a6c7bd567b1301b04ac4c591f4ea8e8d24178536780a78352418e6a94004c"}
Jul 09 09:33:45.532286 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.532258    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z8fr5" event={"ID":"f7239d49-2a5a-43dd-ba67-ccb7535bd293","Type":"ContainerStarted","Data":"be9b96183c960ff9ba24ff2960f050bdd9b01c930a78563da3dd6c13ab271c12"}
Jul 09 09:33:45.541988 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.541960    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"73e457927060d62396685fcdcaffb6e2a67a79dc21162be7009839a50e3c75f4"}
Jul 09 09:33:45.554093 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.554058    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7jfvb" event={"ID":"9f014bc1-a21f-421c-95fc-a54798192207","Type":"ContainerStarted","Data":"49e1ef942fbb77ca953edb010e271dd9e7e7a0ef447c567bcc7890fb7cc8e897"}
Jul 09 09:33:45.565361 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.565327    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8wthl" event={"ID":"24e6c876-35de-40d7-9aa9-89577ef79ea7","Type":"ContainerStarted","Data":"2657ec73f13f947f42e3991c8794e69cd22900ba5631dcaf53e2e72fa46952ec"}
Jul 09 09:33:45.576643 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.576612    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899" event={"ID":"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b","Type":"ContainerStarted","Data":"f626853dafcbf3971dce44f53d606041937bd0f969ce9ebb28b49049ec87bfd4"}
Jul 09 09:33:45.588650 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.588581    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b9jth" event={"ID":"ebcd178a-b784-413e-9ace-21252e141ddc","Type":"ContainerStarted","Data":"179f939b67fc8cb9ce997145611d0f833511d331158c40c2cf1b7344ef7e260b"}
Jul 09 09:33:45.907032 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.906913    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:45.907032 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.906999    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:45.907383 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:45.907041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:45.907383 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907170    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:45.907383 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907259    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs podName:294a299b-397e-431f-bc41-2e95b263e091 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:47.907219546 +0000 UTC m=+6.025579384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs") pod "network-metrics-daemon-nvq9w" (UID: "294a299b-397e-431f-bc41-2e95b263e091") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:45.907750 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907726    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:33:45.907816 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907756    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:33:45.907816 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907770    2585 projected.go:196] Error preparing data for projected volume kube-api-access-gdcr7 for pod openshift-network-diagnostics/network-check-target-v5t9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:45.907926 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907822    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7 podName:5c104045-fe61-4062-abbd-10c3fd4866d7 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:47.907805201 +0000 UTC m=+6.026165038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdcr7" (UniqueName: "kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7") pod "network-check-target-v5t9z" (UID: "5c104045-fe61-4062-abbd-10c3fd4866d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:45.907926 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907887    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:45.907926 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:45.907920    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret podName:6b2f1a17-546c-4814-be44-ae594f9a1752 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:47.907909103 +0000 UTC m=+6.026268918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret") pod "global-pull-secret-syncer-skqw5" (UID: "6b2f1a17-546c-4814-be44-ae594f9a1752") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:46.337302 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:46.336913    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 09:28:44 +0000 UTC" deadline="2028-02-22 09:10:49.763981376 +0000 UTC"
Jul 09 09:33:46.337302 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:46.336973    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14231h37m3.427011978s"
Jul 09 09:33:46.468910 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:46.468387    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:46.468910 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:46.468535    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:46.469471 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:46.469324    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:46.469471 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:46.469433    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:47.467636 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:47.467590    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:47.468145 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.467726    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:47.924023 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:47.923937    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:47.924023 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:47.924015    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:47.924271 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:47.924054    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:47.924271 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924187    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:47.924271 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924264    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs podName:294a299b-397e-431f-bc41-2e95b263e091 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:51.924242247 +0000 UTC m=+10.042602074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs") pod "network-metrics-daemon-nvq9w" (UID: "294a299b-397e-431f-bc41-2e95b263e091") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:47.924751 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924708    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:33:47.924751 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924732    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:33:47.924751 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924746    2585 projected.go:196] Error preparing data for projected volume kube-api-access-gdcr7 for pod openshift-network-diagnostics/network-check-target-v5t9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:47.924985 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924799    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7 podName:5c104045-fe61-4062-abbd-10c3fd4866d7 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:51.924781379 +0000 UTC m=+10.043141194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdcr7" (UniqueName: "kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7") pod "network-check-target-v5t9z" (UID: "5c104045-fe61-4062-abbd-10c3fd4866d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:47.924985 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924868    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:47.924985 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:47.924902    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret podName:6b2f1a17-546c-4814-be44-ae594f9a1752 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:51.924889943 +0000 UTC m=+10.043249756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret") pod "global-pull-secret-syncer-skqw5" (UID: "6b2f1a17-546c-4814-be44-ae594f9a1752") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:48.468184 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:48.468148    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:48.468644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:48.468310    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:48.468644 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:48.468309    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:48.468644 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:48.468402    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:49.467780 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:49.467258    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:49.467780 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:49.467404    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:50.467705 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:50.467123    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:50.467705 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:50.467315    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:50.468267 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:50.467130    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:50.468267 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:50.467837    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:51.467008 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:51.466968    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:51.467176 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.467119    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:51.957804 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:51.957677    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:51.957804 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:51.957763    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:51.957805    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.957881    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.957909    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.957920    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.957926    2585 projected.go:196] Error preparing data for projected volume kube-api-access-gdcr7 for pod openshift-network-diagnostics/network-check-target-v5t9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.957988    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7 podName:5c104045-fe61-4062-abbd-10c3fd4866d7 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:59.957966135 +0000 UTC m=+18.076325965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdcr7" (UniqueName: "kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7") pod "network-check-target-v5t9z" (UID: "5c104045-fe61-4062-abbd-10c3fd4866d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.958012    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs podName:294a299b-397e-431f-bc41-2e95b263e091 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:59.958000668 +0000 UTC m=+18.076360485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs") pod "network-metrics-daemon-nvq9w" (UID: "294a299b-397e-431f-bc41-2e95b263e091") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.958076    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:51.958472 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:51.958110    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret podName:6b2f1a17-546c-4814-be44-ae594f9a1752 nodeName:}" failed. No retries permitted until 2026-07-09 09:33:59.958099785 +0000 UTC m=+18.076459600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret") pod "global-pull-secret-syncer-skqw5" (UID: "6b2f1a17-546c-4814-be44-ae594f9a1752") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:33:52.471107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:52.471073    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:52.471321 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:52.471250    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:52.471321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:52.471288    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:52.471444 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:52.471396    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:53.467935 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:53.467456    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:53.467935 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:53.467581    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:54.470930 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:54.470373    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:54.470930 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:54.470508    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:54.470930 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:54.470545    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:54.470930 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:54.470613    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:55.467251 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:55.467215    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:55.467394 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:55.467318    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:56.469658 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:56.469631    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:56.470086 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:56.469720    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:56.470086 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:56.469741    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:56.470086 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:56.469848    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:57.466829 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:57.466787    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:57.466988 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:57.466934    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:33:58.469875 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:58.469846    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:33:58.470330 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:58.469987    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:33:58.470330 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:58.470045    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:33:58.470330 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:58.470191    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:33:59.467130 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:33:59.467098    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:33:59.467358 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:33:59.467236    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:00.017804 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:00.017764    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:00.017846    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:00.017882    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.017933    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.017958    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.017971    2585 projected.go:196] Error preparing data for projected volume kube-api-access-gdcr7 for pod openshift-network-diagnostics/network-check-target-v5t9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.017987    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.017988    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.018023    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7 podName:5c104045-fe61-4062-abbd-10c3fd4866d7 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:16.018008693 +0000 UTC m=+34.136368523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdcr7" (UniqueName: "kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7") pod "network-check-target-v5t9z" (UID: "5c104045-fe61-4062-abbd-10c3fd4866d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.018068    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs podName:294a299b-397e-431f-bc41-2e95b263e091 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:16.018051033 +0000 UTC m=+34.136410851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs") pod "network-metrics-daemon-nvq9w" (UID: "294a299b-397e-431f-bc41-2e95b263e091") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:34:00.018233 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.018084    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret podName:6b2f1a17-546c-4814-be44-ae594f9a1752 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:16.018074912 +0000 UTC m=+34.136434721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret") pod "global-pull-secret-syncer-skqw5" (UID: "6b2f1a17-546c-4814-be44-ae594f9a1752") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:34:00.470465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:00.470380    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:00.470465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:00.470439    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:00.470657 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.470508    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:00.470657 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:00.470599    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:01.467548 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:01.467300    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:01.467914 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:01.467646    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:02.467832 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:02.467794    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:02.468284 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:02.467971    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:02.468284 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:02.468026    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:02.468284 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:02.468119    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:03.467752 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:03.467712    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:03.467916 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:03.467847    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:04.467125 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:04.467090    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:04.467318 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:04.467094    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:04.467318 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:04.467241    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:04.467318 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:04.467294    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:05.467142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.466979    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:05.467691 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:05.467228    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:05.649033 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.648995    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b9jth" event={"ID":"ebcd178a-b784-413e-9ace-21252e141ddc","Type":"ContainerStarted","Data":"75e3916bf36c60871cd058aef0f58f3170aefea72e99a6eff0aa6c05b5593d91"}
Jul 09 09:34:05.650445 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.650424    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal" event={"ID":"8937e12f98485ce07bb67269f2903696","Type":"ContainerStarted","Data":"d8897e99688fd0cc99e8b034af4ee1978852d7e712a57638d4ff7959e5217f16"}
Jul 09 09:34:05.657627 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.657319    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:34:05.658195 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.658146    2585 generic.go:356] "Generic (PLEG): container finished" podID="c3fff5db-218c-40db-b781-06820aaee71c" containerID="094bc69eee4c473f941e3d5a94d578e2ec3ca99835f06773b079384e292f636d" exitCode=1
Jul 09 09:34:05.658303 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.658283    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"a7a2d9cda9de2bb44e46e3967dae941aba08f21cc2879010ff1e84796d153903"}
Jul 09 09:34:05.658376 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.658361    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"6b5125bff4c5a828e60ae540a139635f5115cc4d4ed99930d1cd63e80e9a3e88"}
Jul 09 09:34:05.658432 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.658415    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"c92be47034bf9ec06c056c86ef30cc68f5a53d5ce5104c8e9c849d14cf17f125"}
Jul 09 09:34:05.658483 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.658464    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"24a1ae493bb5924ad7131ae26f58a39a7e298e63cdb914e0c3068dfc63316489"}
Jul 09 09:34:05.658548 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.658512    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerDied","Data":"094bc69eee4c473f941e3d5a94d578e2ec3ca99835f06773b079384e292f636d"}
Jul 09 09:34:05.658599 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.658562    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"d20c3ea238059823b4a8d403869701c04dd8559e6f81530b6d377361b20758e8"}
Jul 09 09:34:05.660893 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.660864    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7jfvb" event={"ID":"9f014bc1-a21f-421c-95fc-a54798192207","Type":"ContainerStarted","Data":"ab222063f4f0eee3d511126e3ba9c25df3bfa36329570199fe629594c7bf543e"}
Jul 09 09:34:05.670597 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.670551    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b9jth" podStartSLOduration=2.346754943 podStartE2EDuration="22.670539015s" totalImagesPullingTime="20.323784072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:05.670467801 +0000 UTC m=+23.788827636" watchObservedRunningTime="2026-07-09 09:34:05.670539015 +0000 UTC m=+23.788898846"
Jul 09 09:34:05.690571 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.690525    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7jfvb" podStartSLOduration=2.395647517 podStartE2EDuration="22.690506096s" totalImagesPullingTime="20.294858579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:05.690335591 +0000 UTC m=+23.808695424" watchObservedRunningTime="2026-07-09 09:34:05.690506096 +0000 UTC m=+23.808865927"
Jul 09 09:34:05.708072 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:05.708020    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-170.ec2.internal" podStartSLOduration=21.708001307 podStartE2EDuration="21.708001307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:05.707892543 +0000 UTC m=+23.826252376" watchObservedRunningTime="2026-07-09 09:34:05.708001307 +0000 UTC m=+23.826361141"
Jul 09 09:34:06.467637 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.467404    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:06.468052 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.467475    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:06.468052 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:06.467651    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:06.468052 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:06.467730    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:06.663966 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.663926    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h2n7j" event={"ID":"cd6084d8-d2de-482b-acdf-695e4c610731","Type":"ContainerStarted","Data":"54f307f38b616cf7504778e712815b7c3a7ac3332149520538b9684f530ade19"}
Jul 09 09:34:06.665368 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.665334    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbfl4" event={"ID":"d1df4c6e-941b-43fd-b31b-3844983066c2","Type":"ContainerStarted","Data":"1032cc2d735ef3045245ee9f4923bdacda34be29e806a3450564899476d362a9"}
Jul 09 09:34:06.666682 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.666662    2585 generic.go:356] "Generic (PLEG): container finished" podID="de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10" containerID="bd9e4396ba3f95bf83e966d79a3bd85b2293155c4fc64ec8f7042d3ea90b70db" exitCode=0
Jul 09 09:34:06.666815 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.666726    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerDied","Data":"bd9e4396ba3f95bf83e966d79a3bd85b2293155c4fc64ec8f7042d3ea90b70db"}
Jul 09 09:34:06.668224 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.668207    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z8fr5" event={"ID":"f7239d49-2a5a-43dd-ba67-ccb7535bd293","Type":"ContainerStarted","Data":"80a3ccc1e817872a85865dfa02c4be76434dc7b48231cf52729b6b0ab5f4fc11"}
Jul 09 09:34:06.669649 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.669633    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8wthl" event={"ID":"24e6c876-35de-40d7-9aa9-89577ef79ea7","Type":"ContainerStarted","Data":"d266427529f5695f50264729a273bb07185384ea484092ec42e71b7e45244f27"}
Jul 09 09:34:06.670997 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.670975    2585 generic.go:356] "Generic (PLEG): container finished" podID="23a151c531fccc836288ce0dea3b0149" containerID="53add433320ced7cbf9ad9867072c47f49785b1b39f0ec875237c8e8680b785f" exitCode=0
Jul 09 09:34:06.671082 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.671024    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal" event={"ID":"23a151c531fccc836288ce0dea3b0149","Type":"ContainerDied","Data":"53add433320ced7cbf9ad9867072c47f49785b1b39f0ec875237c8e8680b785f"}
Jul 09 09:34:06.672476 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.672457    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899" event={"ID":"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b","Type":"ContainerStarted","Data":"4c88f5ba5aee66d3f68a93c4548e2873c75f085a5de2c532fe692d9b7ce6deb2"}
Jul 09 09:34:06.701074 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.701038    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kbfl4" podStartSLOduration=3.441123473 podStartE2EDuration="23.701027794s" totalImagesPullingTime="20.259904321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:06.700908206 +0000 UTC m=+24.819268037" watchObservedRunningTime="2026-07-09 09:34:06.701027794 +0000 UTC m=+24.819387625"
Jul 09 09:34:06.701172 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.701106    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h2n7j" podStartSLOduration=3.448654684 podStartE2EDuration="23.701101077s" totalImagesPullingTime="20.252446393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:06.681542414 +0000 UTC m=+24.799902244" watchObservedRunningTime="2026-07-09 09:34:06.701101077 +0000 UTC m=+24.819460909"
Jul 09 09:34:06.770242 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.770199    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z8fr5" podStartSLOduration=3.490783231 podStartE2EDuration="23.77016987s" totalImagesPullingTime="20.279386639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:06.744480535 +0000 UTC m=+24.862840369" watchObservedRunningTime="2026-07-09 09:34:06.77016987 +0000 UTC m=+24.888529741"
Jul 09 09:34:06.770629 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.770603    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8wthl" podStartSLOduration=3.477671233 podStartE2EDuration="23.770594045s" totalImagesPullingTime="20.292922812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:06.769886815 +0000 UTC m=+24.888246658" watchObservedRunningTime="2026-07-09 09:34:06.770594045 +0000 UTC m=+24.888953876"
Jul 09 09:34:06.922197 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:06.922157    2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 09:34:07.370795 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:07.370689    2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T09:34:06.922193919Z","UUID":"8bc9b540-130a-4565-962d-41fc1e14b3db","Handler":null,"Name":"","Endpoint":""}
Jul 09 09:34:07.372388 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:07.372366    2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 09:34:07.372518 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:07.372405    2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 09:34:07.467514 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:07.467483    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:07.467713 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:07.467594    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:07.677687 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:07.677596    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal" event={"ID":"23a151c531fccc836288ce0dea3b0149","Type":"ContainerStarted","Data":"bf0079193c99e9e5a940175a07eb6e20ee26a939849755527e9cbeeb42cf591c"}
Jul 09 09:34:07.680849 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:07.680505    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899" event={"ID":"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b","Type":"ContainerStarted","Data":"69bbb1e802b179e160cfa00026469dc4802addb152d22b2dabd9d1a9cb80bc0d"}
Jul 09 09:34:07.697826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:07.697703    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-170.ec2.internal" podStartSLOduration=23.697685791 podStartE2EDuration="23.697685791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:07.697292513 +0000 UTC m=+25.815652346" watchObservedRunningTime="2026-07-09 09:34:07.697685791 +0000 UTC m=+25.816045625"
Jul 09 09:34:08.467087 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:08.467006    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:08.467252 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:08.467146    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:08.467252 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:08.467203    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:08.467371 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:08.467316    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:08.684955 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:08.684916    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899" event={"ID":"4c91c6d2-8c62-4f1b-a3ce-5de55d57b72b","Type":"ContainerStarted","Data":"b562c69f685251f1e2f0f3c440ebcfb0712816955f8033f3823503dc653a3035"}
Jul 09 09:34:08.688801 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:08.688776    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:34:08.689162 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:08.689131    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"d5bbb1d66908e1257a13a38696d7bc32f86afa1eb41dd6c26def4ff6bc49db10"}
Jul 09 09:34:08.706750 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:08.706707    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq899" podStartSLOduration=3.177488646 podStartE2EDuration="25.70669331s" totalImagesPullingTime="22.529204664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:08.706105037 +0000 UTC m=+26.824464870" watchObservedRunningTime="2026-07-09 09:34:08.70669331 +0000 UTC m=+26.825053142"
Jul 09 09:34:09.467489 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:09.467445    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:09.467677 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:09.467594    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:10.467450 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:10.467371    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:10.467450 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:10.467412    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:10.467931 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:10.467519    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:10.467931 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:10.467645    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:10.659554 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:10.659398    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:34:10.659984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:10.659966    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:34:10.693710 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:10.693659    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:34:10.694136 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:10.694119    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h2n7j"
Jul 09 09:34:11.467429 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.467331    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:11.467591 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:11.467448    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:11.698720 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.698695    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:34:11.699056 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.699029    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"253b6074c6869a7e00a8a1ff387c87ec998824514d3118047ea4b22518b6ccae"}
Jul 09 09:34:11.699283 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.699263    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:34:11.699371 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.699329    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:34:11.699473 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.699460    2585 scope.go:117] "RemoveContainer" containerID="094bc69eee4c473f941e3d5a94d578e2ec3ca99835f06773b079384e292f636d"
Jul 09 09:34:11.701030 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.701001    2585 generic.go:356] "Generic (PLEG): container finished" podID="de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10" containerID="313ba220abf5e06634a6acd59b03dc7f0e841d0e229791bd56b0176d95f88665" exitCode=0
Jul 09 09:34:11.701129 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.701053    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerDied","Data":"313ba220abf5e06634a6acd59b03dc7f0e841d0e229791bd56b0176d95f88665"}
Jul 09 09:34:11.715285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:11.715267    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:34:12.469105 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:12.468867    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:12.469571 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:12.468920    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:12.469571 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:12.469227    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:12.469571 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:12.469287    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:12.706284 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:12.706258    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:34:12.706631 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:12.706597    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" event={"ID":"c3fff5db-218c-40db-b781-06820aaee71c","Type":"ContainerStarted","Data":"b6e29efde86436d345924eeb9d80ac9e5ec36027cac8b942e56c28d2693f4795"}
Jul 09 09:34:12.706840 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:12.706826    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:34:12.721656 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:12.721603    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:34:12.743341 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:12.743301    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj" podStartSLOduration=9.385718456 podStartE2EDuration="29.743288237s" totalImagesPullingTime="20.357569781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:12.740557472 +0000 UTC m=+30.858917304" watchObservedRunningTime="2026-07-09 09:34:12.743288237 +0000 UTC m=+30.861648069"
Jul 09 09:34:13.466933 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:13.466907    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:13.467080 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:13.467000    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:13.711139 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:13.711108    2585 generic.go:356] "Generic (PLEG): container finished" podID="de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10" containerID="71c3d2bad1709d9a20cebf45fd3677a8b5c6678053fcf62c0c19b7611327b74c" exitCode=0
Jul 09 09:34:13.711518 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:13.711204    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerDied","Data":"71c3d2bad1709d9a20cebf45fd3677a8b5c6678053fcf62c0c19b7611327b74c"}
Jul 09 09:34:14.467611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:14.467579    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:14.467758 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:14.467639    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:14.467758 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:14.467716    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:14.467867 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:14.467836    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:15.467748 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:15.467719    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:15.468152 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:15.467812    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:15.717435 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:15.717399    2585 generic.go:356] "Generic (PLEG): container finished" podID="de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10" containerID="75a105876253b42d4cba891532e92b610adef5bf3e4003460c82f2785fff84d8" exitCode=0
Jul 09 09:34:15.717622 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:15.717464    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerDied","Data":"75a105876253b42d4cba891532e92b610adef5bf3e4003460c82f2785fff84d8"}
Jul 09 09:34:16.033996 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:16.033904    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:16.033996 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:16.033959    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:16.033996 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:16.033996    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034052    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034080    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034101    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034114    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034122    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret podName:6b2f1a17-546c-4814-be44-ae594f9a1752 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:48.034102958 +0000 UTC m=+66.152462768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret") pod "global-pull-secret-syncer-skqw5" (UID: "6b2f1a17-546c-4814-be44-ae594f9a1752") : object "kube-system"/"original-pull-secret" not registered
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034125    2585 projected.go:196] Error preparing data for projected volume kube-api-access-gdcr7 for pod openshift-network-diagnostics/network-check-target-v5t9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034161    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7 podName:5c104045-fe61-4062-abbd-10c3fd4866d7 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:48.034150483 +0000 UTC m=+66.152510310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdcr7" (UniqueName: "kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7") pod "network-check-target-v5t9z" (UID: "5c104045-fe61-4062-abbd-10c3fd4866d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 09:34:16.034246 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.034174    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs podName:294a299b-397e-431f-bc41-2e95b263e091 nodeName:}" failed. No retries permitted until 2026-07-09 09:34:48.03416856 +0000 UTC m=+66.152528370 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs") pod "network-metrics-daemon-nvq9w" (UID: "294a299b-397e-431f-bc41-2e95b263e091") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 09:34:16.466856 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:16.466827    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:16.466999 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:16.466826    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:16.466999 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.466949    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:16.467122 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:16.467024    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:17.467440 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:17.467405    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:17.467840 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:17.467518    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:18.467849 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:18.467816    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:18.468327 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:18.467952    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:18.468327 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:18.467993    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:18.468327 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:18.468083    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:19.467755 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:19.467720    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:19.467923 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:19.467853    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:19.729480 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:19.729407    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerStarted","Data":"700569bf355a1257d4afc1c23b4a36675b4c4828fbe641970141579ee3969e7c"}
Jul 09 09:34:20.466881 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:20.466851    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:20.467045 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:20.466962    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:20.467045 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:20.467020    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:20.467122 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:20.467105    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:20.734046 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:20.733963    2585 generic.go:356] "Generic (PLEG): container finished" podID="de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10" containerID="700569bf355a1257d4afc1c23b4a36675b4c4828fbe641970141579ee3969e7c" exitCode=0
Jul 09 09:34:20.734046 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:20.734011    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerDied","Data":"700569bf355a1257d4afc1c23b4a36675b4c4828fbe641970141579ee3969e7c"}
Jul 09 09:34:21.467735 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:21.467704    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:21.467871 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:21.467799    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:21.739656 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:21.739574    2585 generic.go:356] "Generic (PLEG): container finished" podID="de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10" containerID="85db74074654da89698981b971a0753e0cc90cfe5d97630a757a524141cc3e25" exitCode=0
Jul 09 09:34:21.739656 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:21.739642    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerDied","Data":"85db74074654da89698981b971a0753e0cc90cfe5d97630a757a524141cc3e25"}
Jul 09 09:34:22.467557 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:22.467525    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:22.467738 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:22.467600    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:22.467738 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:22.467682    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:22.467855 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:22.467801    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:22.745123 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:22.745049    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" event={"ID":"de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10","Type":"ContainerStarted","Data":"0a9b8c44002310f956a58474045c48ababea05d1858c5ea0afe176317530d19b"}
Jul 09 09:34:22.770067 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:22.770028    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8jdfh" podStartSLOduration=9.220105254 podStartE2EDuration="39.770017064s" totalImagesPullingTime="30.54991181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:22.768404643 +0000 UTC m=+40.886764475" watchObservedRunningTime="2026-07-09 09:34:22.770017064 +0000 UTC m=+40.888376896"
Jul 09 09:34:23.467330 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:23.467299    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:23.467496 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:23.467399    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:24.467698 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:24.467662    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:24.468062 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:24.467666    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:24.468062 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:24.467776    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:24.468062 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:24.467846    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:25.467302 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:25.467271    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:25.467443 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:25.467394    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:26.467785 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:26.467759    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:26.468157 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:26.467860    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:26.468157 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:26.467916    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:26.468157 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:26.468008    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:27.467619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:27.467591    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:27.467788 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:27.467688    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:27.862536 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:27.862328    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvq9w"]
Jul 09 09:34:27.863013 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:27.862664    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:27.863013 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:27.862795    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:27.863271 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:27.863245    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skqw5"]
Jul 09 09:34:27.863381 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:27.863339    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:27.863455 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:27.863431    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:27.864041 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:27.864017    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v5t9z"]
Jul 09 09:34:27.864131 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:27.864104    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:27.864236 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:27.864216    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:29.467131 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:29.467096    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:29.467586 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:29.467100    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:29.467586 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:29.467219    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:29.467586 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:29.467105    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:29.467586 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:29.467276    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:29.467586 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:29.467385    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:31.467770 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.467733    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:31.468258 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.467733    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:31.468258 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:31.467862    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvq9w" podUID="294a299b-397e-431f-bc41-2e95b263e091"
Jul 09 09:34:31.468258 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.467732    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:31.468258 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:31.467949    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5t9z" podUID="5c104045-fe61-4062-abbd-10c3fd4866d7"
Jul 09 09:34:31.468258 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:31.467988    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skqw5" podUID="6b2f1a17-546c-4814-be44-ae594f9a1752"
Jul 09 09:34:31.700011 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.699940    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-170.ec2.internal" event="NodeReady"
Jul 09 09:34:31.700147 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.700070    2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 09:34:31.757485 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.757453    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wrxt4"]
Jul 09 09:34:31.786804 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.786774    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lgl65"]
Jul 09 09:34:31.786948 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.786901    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.789339 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.789310    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cfzpw\""
Jul 09 09:34:31.789504 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.789486    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 09:34:31.789602 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.789588    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 09:34:31.810291 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.810265    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgl65"]
Jul 09 09:34:31.810405 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.810298    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wrxt4"]
Jul 09 09:34:31.810405 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.810323    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xvqd8"]
Jul 09 09:34:31.810405 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.810380    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:31.813230 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.813170    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 09:34:31.813432 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.813415    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g7jnx\""
Jul 09 09:34:31.813514 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.813452    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 09:34:31.813745 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.813725    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 09:34:31.828396 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.828377    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xvqd8"]
Jul 09 09:34:31.828505 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.828475    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.830728 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.830710    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 09:34:31.830839 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.830764    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 09:34:31.830839 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.830713    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 09:34:31.830839 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.830710    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 09:34:31.831035 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.831023    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zwk2d\""
Jul 09 09:34:31.852606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852579    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q565c\" (UniqueName: \"kubernetes.io/projected/649acb02-775d-40c1-9e70-dd7ca087e7ff-kube-api-access-q565c\") pod \"ingress-canary-lgl65\" (UID: \"649acb02-775d-40c1-9e70-dd7ca087e7ff\") " pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:31.852606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852607    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-metrics-tls\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.852793 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852626    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dce7b893-247b-49dc-8a33-b33442f79218-crio-socket\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.852793 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852647    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce7b893-247b-49dc-8a33-b33442f79218-data-volume\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.852793 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/649acb02-775d-40c1-9e70-dd7ca087e7ff-cert\") pod \"ingress-canary-lgl65\" (UID: \"649acb02-775d-40c1-9e70-dd7ca087e7ff\") " pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:31.852793 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852742    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jzt\" (UniqueName: \"kubernetes.io/projected/dce7b893-247b-49dc-8a33-b33442f79218-kube-api-access-78jzt\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.852793 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852765    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dce7b893-247b-49dc-8a33-b33442f79218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.852942 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852811    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-config-volume\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.852942 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852835    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-tmp-dir\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.852942 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852852    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dce7b893-247b-49dc-8a33-b33442f79218-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.852942 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.852871    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqhz\" (UniqueName: \"kubernetes.io/projected/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-kube-api-access-zfqhz\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.953232 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953125    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-tmp-dir\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.953232 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953168    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dce7b893-247b-49dc-8a33-b33442f79218-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.953232 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953223    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqhz\" (UniqueName: \"kubernetes.io/projected/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-kube-api-access-zfqhz\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.953496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953269    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q565c\" (UniqueName: \"kubernetes.io/projected/649acb02-775d-40c1-9e70-dd7ca087e7ff-kube-api-access-q565c\") pod \"ingress-canary-lgl65\" (UID: \"649acb02-775d-40c1-9e70-dd7ca087e7ff\") " pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:31.953496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953290    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-metrics-tls\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.953496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953319    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dce7b893-247b-49dc-8a33-b33442f79218-crio-socket\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.953496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953349    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce7b893-247b-49dc-8a33-b33442f79218-data-volume\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.953496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/649acb02-775d-40c1-9e70-dd7ca087e7ff-cert\") pod \"ingress-canary-lgl65\" (UID: \"649acb02-775d-40c1-9e70-dd7ca087e7ff\") " pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:31.953496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953442    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jzt\" (UniqueName: \"kubernetes.io/projected/dce7b893-247b-49dc-8a33-b33442f79218-kube-api-access-78jzt\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.953496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953482    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-tmp-dir\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.953869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953599    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dce7b893-247b-49dc-8a33-b33442f79218-crio-socket\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.953869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953726    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dce7b893-247b-49dc-8a33-b33442f79218-data-volume\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.953991 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953974    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dce7b893-247b-49dc-8a33-b33442f79218-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.954050 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.953996    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dce7b893-247b-49dc-8a33-b33442f79218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.954050 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.954037    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-config-volume\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.954486 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.954465    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-config-volume\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.957316 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.957298    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dce7b893-247b-49dc-8a33-b33442f79218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.957316 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.957313    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-metrics-tls\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:31.957466 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.957409    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/649acb02-775d-40c1-9e70-dd7ca087e7ff-cert\") pod \"ingress-canary-lgl65\" (UID: \"649acb02-775d-40c1-9e70-dd7ca087e7ff\") " pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:31.962832 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.962809    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q565c\" (UniqueName: \"kubernetes.io/projected/649acb02-775d-40c1-9e70-dd7ca087e7ff-kube-api-access-q565c\") pod \"ingress-canary-lgl65\" (UID: \"649acb02-775d-40c1-9e70-dd7ca087e7ff\") " pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:31.963223 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.963199    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jzt\" (UniqueName: \"kubernetes.io/projected/dce7b893-247b-49dc-8a33-b33442f79218-kube-api-access-78jzt\") pod \"insights-runtime-extractor-xvqd8\" (UID: \"dce7b893-247b-49dc-8a33-b33442f79218\") " pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:31.967298 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:31.967273    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqhz\" (UniqueName: \"kubernetes.io/projected/4228cd80-ca4e-4b5c-b083-c0348ddfdb57-kube-api-access-zfqhz\") pod \"dns-default-wrxt4\" (UID: \"4228cd80-ca4e-4b5c-b083-c0348ddfdb57\") " pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:32.097050 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.097019    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:32.118136 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.118106    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgl65"
Jul 09 09:34:32.136648 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.136628    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xvqd8"
Jul 09 09:34:32.330092 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.327585    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wrxt4"]
Jul 09 09:34:32.330273 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.330189    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgl65"]
Jul 09 09:34:32.336163 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:32.336135    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4228cd80_ca4e_4b5c_b083_c0348ddfdb57.slice/crio-dfc032734cbd944fd15964ee43148381d38deb93ece31ab69dbbf271fb218ebd WatchSource:0}: Error finding container dfc032734cbd944fd15964ee43148381d38deb93ece31ab69dbbf271fb218ebd: Status 404 returned error can't find the container with id dfc032734cbd944fd15964ee43148381d38deb93ece31ab69dbbf271fb218ebd
Jul 09 09:34:32.340420 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.340268    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xvqd8"]
Jul 09 09:34:32.343583 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:32.343560    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce7b893_247b_49dc_8a33_b33442f79218.slice/crio-b91d53dc36d369a7340e589d6f3b172f49996c1d57c86f839c025fbca2ad520c WatchSource:0}: Error finding container b91d53dc36d369a7340e589d6f3b172f49996c1d57c86f839c025fbca2ad520c: Status 404 returned error can't find the container with id b91d53dc36d369a7340e589d6f3b172f49996c1d57c86f839c025fbca2ad520c
Jul 09 09:34:32.768441 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.768401    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvqd8" event={"ID":"dce7b893-247b-49dc-8a33-b33442f79218","Type":"ContainerStarted","Data":"b91d53dc36d369a7340e589d6f3b172f49996c1d57c86f839c025fbca2ad520c"}
Jul 09 09:34:32.769899 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.769870    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgl65" event={"ID":"649acb02-775d-40c1-9e70-dd7ca087e7ff","Type":"ContainerStarted","Data":"776ce15b27a24f9944ec8d16e4489550fb5a4d6fffbcc48f099dd5ca5b426de4"}
Jul 09 09:34:32.771133 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:32.771109    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrxt4" event={"ID":"4228cd80-ca4e-4b5c-b083-c0348ddfdb57","Type":"ContainerStarted","Data":"dfc032734cbd944fd15964ee43148381d38deb93ece31ab69dbbf271fb218ebd"}
Jul 09 09:34:33.425350 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.425319    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"]
Jul 09 09:34:33.439418 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.439395    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"]
Jul 09 09:34:33.439565 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.439506    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"
Jul 09 09:34:33.442069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.442047    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-72hcj\""
Jul 09 09:34:33.442377 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.442361    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 09:34:33.467738 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.467717    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:33.468096 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.468080    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:33.468469 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.468449    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:33.483095 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.482434    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 09:34:33.483095 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.482660    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 09:34:33.483095 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.482956    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 09:34:33.483749 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.483594    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ntnhc\""
Jul 09 09:34:33.485469 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.485451    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7trk\""
Jul 09 09:34:33.488343 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.488141    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 09:34:33.566942 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.566627    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/75b703dc-9bec-4df0-97cc-1d692388046b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6xrpk\" (UID: \"75b703dc-9bec-4df0-97cc-1d692388046b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"
Jul 09 09:34:33.667954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.667828    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/75b703dc-9bec-4df0-97cc-1d692388046b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6xrpk\" (UID: \"75b703dc-9bec-4df0-97cc-1d692388046b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"
Jul 09 09:34:33.674835 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.674784    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/75b703dc-9bec-4df0-97cc-1d692388046b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6xrpk\" (UID: \"75b703dc-9bec-4df0-97cc-1d692388046b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"
Jul 09 09:34:33.752932 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.752609    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"
Jul 09 09:34:33.935639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:33.935603    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"]
Jul 09 09:34:33.941768 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:33.941739    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b703dc_9bec_4df0_97cc_1d692388046b.slice/crio-2db7a6080c9045afbef4da1412c056fbbefd44c4cf388a8fe41e4e4a7a5dbae7 WatchSource:0}: Error finding container 2db7a6080c9045afbef4da1412c056fbbefd44c4cf388a8fe41e4e4a7a5dbae7: Status 404 returned error can't find the container with id 2db7a6080c9045afbef4da1412c056fbbefd44c4cf388a8fe41e4e4a7a5dbae7
Jul 09 09:34:34.778644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:34.778606    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk" event={"ID":"75b703dc-9bec-4df0-97cc-1d692388046b","Type":"ContainerStarted","Data":"2db7a6080c9045afbef4da1412c056fbbefd44c4cf388a8fe41e4e4a7a5dbae7"}
Jul 09 09:34:36.077703 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.077670    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-j5m2p"]
Jul 09 09:34:36.109406 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.109370    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-j5m2p"]
Jul 09 09:34:36.109566 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.109490    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-j5m2p"
Jul 09 09:34:36.112270 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.112240    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 09:34:36.112535 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.112498    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 09:34:36.112652 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.112594    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l2s9s\""
Jul 09 09:34:36.181391 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.181320    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxhl\" (UniqueName: \"kubernetes.io/projected/d8b57aa2-ca85-4d76-ab3f-7807db131fdb-kube-api-access-7gxhl\") pod \"downloads-685bfb5f64-j5m2p\" (UID: \"d8b57aa2-ca85-4d76-ab3f-7807db131fdb\") " pod="openshift-console/downloads-685bfb5f64-j5m2p"
Jul 09 09:34:36.282222 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.282159    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxhl\" (UniqueName: \"kubernetes.io/projected/d8b57aa2-ca85-4d76-ab3f-7807db131fdb-kube-api-access-7gxhl\") pod \"downloads-685bfb5f64-j5m2p\" (UID: \"d8b57aa2-ca85-4d76-ab3f-7807db131fdb\") " pod="openshift-console/downloads-685bfb5f64-j5m2p"
Jul 09 09:34:36.294325 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.294294    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxhl\" (UniqueName: \"kubernetes.io/projected/d8b57aa2-ca85-4d76-ab3f-7807db131fdb-kube-api-access-7gxhl\") pod \"downloads-685bfb5f64-j5m2p\" (UID: \"d8b57aa2-ca85-4d76-ab3f-7807db131fdb\") " pod="openshift-console/downloads-685bfb5f64-j5m2p"
Jul 09 09:34:36.421211 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:36.421161    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-j5m2p"
Jul 09 09:34:38.788614 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:38.788548    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-j5m2p"]
Jul 09 09:34:38.845868 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:38.845839    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b57aa2_ca85_4d76_ab3f_7807db131fdb.slice/crio-b5e166edfd374b8854a81e389db726161c46e539870dafb8dfcc4264875c010f WatchSource:0}: Error finding container b5e166edfd374b8854a81e389db726161c46e539870dafb8dfcc4264875c010f: Status 404 returned error can't find the container with id b5e166edfd374b8854a81e389db726161c46e539870dafb8dfcc4264875c010f
Jul 09 09:34:39.794620 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.794221    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgl65" event={"ID":"649acb02-775d-40c1-9e70-dd7ca087e7ff","Type":"ContainerStarted","Data":"7d50277988401e1e3622dba536ea380b46d36555edaffa4e7b770f9a6d92cc8e"}
Jul 09 09:34:39.795952 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.795926    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk" event={"ID":"75b703dc-9bec-4df0-97cc-1d692388046b","Type":"ContainerStarted","Data":"da84c41873438ed969317ba2c7c12570fb012ba9ba6d58d560f5eb8c6d45424a"}
Jul 09 09:34:39.796093 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.796073    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"
Jul 09 09:34:39.798240 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.798214    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvqd8" event={"ID":"dce7b893-247b-49dc-8a33-b33442f79218","Type":"ContainerStarted","Data":"d3b9764d69e94b46d30ec935c6765895aff5d34af52bda195427e2f25c1afe4e"}
Jul 09 09:34:39.798359 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.798259    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvqd8" event={"ID":"dce7b893-247b-49dc-8a33-b33442f79218","Type":"ContainerStarted","Data":"f4370b6c4df6e7ca123dad470585c929230b8c88ad89a5472254cc77f57f3685"}
Jul 09 09:34:39.800255 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.800231    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrxt4" event={"ID":"4228cd80-ca4e-4b5c-b083-c0348ddfdb57","Type":"ContainerStarted","Data":"f998dd8626fecd8e2069a1c4b3d82f9e6b904e759dd796873f5a839757ecce35"}
Jul 09 09:34:39.800380 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.800275    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrxt4" event={"ID":"4228cd80-ca4e-4b5c-b083-c0348ddfdb57","Type":"ContainerStarted","Data":"329f3d25159a64fa2f4015964876c00918a376934e55aa6daebc03f5ac12fb49"}
Jul 09 09:34:39.800380 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.800296    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:39.801613 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.801592    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-j5m2p" event={"ID":"d8b57aa2-ca85-4d76-ab3f-7807db131fdb","Type":"ContainerStarted","Data":"b5e166edfd374b8854a81e389db726161c46e539870dafb8dfcc4264875c010f"}
Jul 09 09:34:39.802030 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.801984    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk"
Jul 09 09:34:39.810291 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.810229    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lgl65" podStartSLOduration=2.304428504 podStartE2EDuration="8.810212137s" totalImagesPullingTime="6.505783633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:39.809708309 +0000 UTC m=+57.928068142" watchObservedRunningTime="2026-07-09 09:34:39.810212137 +0000 UTC m=+57.928571951"
Jul 09 09:34:39.826504 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.826453    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6xrpk" podStartSLOduration=1.878909699 podStartE2EDuration="6.826435587s" totalImagesPullingTime="4.947525888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:39.825483638 +0000 UTC m=+57.943843474" watchObservedRunningTime="2026-07-09 09:34:39.826435587 +0000 UTC m=+57.944795421"
Jul 09 09:34:39.846058 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:39.846005    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wrxt4" podStartSLOduration=2.6765868900000003 podStartE2EDuration="8.845992232s" totalImagesPullingTime="6.169405342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:39.8452827 +0000 UTC m=+57.963642544" watchObservedRunningTime="2026-07-09 09:34:39.845992232 +0000 UTC m=+57.964352065"
Jul 09 09:34:40.528955 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.528921    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"]
Jul 09 09:34:40.531196 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.531153    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.535058 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.534916    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 09:34:40.535058 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.534958    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 09:34:40.536107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.535836    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 09:34:40.536107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.535924    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-br6hc\""
Jul 09 09:34:40.536107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.535925    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 09:34:40.536107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.535925    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 09:34:40.549457 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.549434    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"]
Jul 09 09:34:40.614030 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.613995    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e25c210e-0a03-4695-981e-831e4f004bfc-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.614194 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.614071    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.614194 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.614103    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.614300 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.614232    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbv6v\" (UniqueName: \"kubernetes.io/projected/e25c210e-0a03-4695-981e-831e4f004bfc-kube-api-access-vbv6v\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.715429 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.715401    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.715611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.715445    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.715611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.715503    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbv6v\" (UniqueName: \"kubernetes.io/projected/e25c210e-0a03-4695-981e-831e4f004bfc-kube-api-access-vbv6v\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.715611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.715546    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e25c210e-0a03-4695-981e-831e4f004bfc-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.715611 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:40.715573    2585 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 09 09:34:40.715816 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:40.715642    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-tls podName:e25c210e-0a03-4695-981e-831e4f004bfc nodeName:}" failed. No retries permitted until 2026-07-09 09:34:41.21562412 +0000 UTC m=+59.333983930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-9vh9l" (UID: "e25c210e-0a03-4695-981e-831e4f004bfc") : secret "prometheus-operator-tls" not found
Jul 09 09:34:40.716472 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.716447    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e25c210e-0a03-4695-981e-831e4f004bfc-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.719644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.719620    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:40.726309 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:40.726282    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbv6v\" (UniqueName: \"kubernetes.io/projected/e25c210e-0a03-4695-981e-831e4f004bfc-kube-api-access-vbv6v\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:41.221039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:41.221001    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:41.224076 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:41.224049    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e25c210e-0a03-4695-981e-831e4f004bfc-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9vh9l\" (UID: \"e25c210e-0a03-4695-981e-831e4f004bfc\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:41.446334 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:41.446293    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"
Jul 09 09:34:42.496540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:42.496512    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l"]
Jul 09 09:34:42.500027 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:42.499995    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25c210e_0a03_4695_981e_831e4f004bfc.slice/crio-31f13cc638f0487c1caaabd35828db5b53b9bfda6b630dcd60c5bf413ed3bea0 WatchSource:0}: Error finding container 31f13cc638f0487c1caaabd35828db5b53b9bfda6b630dcd60c5bf413ed3bea0: Status 404 returned error can't find the container with id 31f13cc638f0487c1caaabd35828db5b53b9bfda6b630dcd60c5bf413ed3bea0
Jul 09 09:34:42.814574 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:42.814538    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l" event={"ID":"e25c210e-0a03-4695-981e-831e4f004bfc","Type":"ContainerStarted","Data":"31f13cc638f0487c1caaabd35828db5b53b9bfda6b630dcd60c5bf413ed3bea0"}
Jul 09 09:34:42.816810 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:42.816779    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvqd8" event={"ID":"dce7b893-247b-49dc-8a33-b33442f79218","Type":"ContainerStarted","Data":"d9045e425cc9068e83d8aac0fc980e5875f4b55acf3dbfa554d1986b95f49323"}
Jul 09 09:34:44.732035 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:44.731994    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jtwj"
Jul 09 09:34:44.769513 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:44.769463    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xvqd8" podStartSLOduration=3.930745752 podStartE2EDuration="13.76944576s" totalImagesPullingTime="9.838700008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:34:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:42.846545844 +0000 UTC m=+60.964905676" watchObservedRunningTime="2026-07-09 09:34:44.76944576 +0000 UTC m=+62.887805578"
Jul 09 09:34:44.824993 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:44.824956    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l" event={"ID":"e25c210e-0a03-4695-981e-831e4f004bfc","Type":"ContainerStarted","Data":"87b4a2944f5aa63240d08f8112f2b07d8a98a9fe902bd8e7309514fd88ed324f"}
Jul 09 09:34:44.825162 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:44.825056    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l" event={"ID":"e25c210e-0a03-4695-981e-831e4f004bfc","Type":"ContainerStarted","Data":"1e9cef6f208f646160f66c55b9182dbed951ed822847d6bc8d37f60893d5ba9e"}
Jul 09 09:34:44.844320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:44.844275    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9vh9l" podStartSLOduration=3.527709776 podStartE2EDuration="4.844258679s" totalImagesPullingTime="1.316548903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:34:44.84331565 +0000 UTC m=+62.961675483" watchObservedRunningTime="2026-07-09 09:34:44.844258679 +0000 UTC m=+62.962618489"
Jul 09 09:34:45.805093 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.805060    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-579d474fd9-nwgqw"]
Jul 09 09:34:45.832535 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.832507    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579d474fd9-nwgqw"]
Jul 09 09:34:45.832678 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.832589    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.835072 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.835049    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 09:34:45.835272 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.835051    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 09:34:45.835272 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.835087    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 09:34:45.835654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.835638    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 09:34:45.835747 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.835661    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qtbkd\""
Jul 09 09:34:45.835747 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.835721    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 09:34:45.858542 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.858518    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-oauth-serving-cert\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.858681 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.858548    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-oauth-config\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.858681 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.858597    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-config\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.858681 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.858666    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmhhd\" (UniqueName: \"kubernetes.io/projected/c900c443-365b-4ddd-bbdf-b71345f75ed1-kube-api-access-wmhhd\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.858828 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.858726    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-serving-cert\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.858904 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.858885    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-service-ca\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.960242 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.960214    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-service-ca\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.960389 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.960255    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-oauth-serving-cert\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.960389 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.960280    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-oauth-config\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.960389 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.960310    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-config\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.960389 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.960340    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmhhd\" (UniqueName: \"kubernetes.io/projected/c900c443-365b-4ddd-bbdf-b71345f75ed1-kube-api-access-wmhhd\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.960582 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.960406    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-serving-cert\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.961162 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.961109    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-service-ca\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.961342 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.961268    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-oauth-serving-cert\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.961426 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.961349    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-config\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.963244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.963217    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-serving-cert\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.963390 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.963370    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-oauth-config\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:45.973188 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:45.973154    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmhhd\" (UniqueName: \"kubernetes.io/projected/c900c443-365b-4ddd-bbdf-b71345f75ed1-kube-api-access-wmhhd\") pod \"console-579d474fd9-nwgqw\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") " pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:46.141165 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.141121    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:34:46.286226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.286196    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579d474fd9-nwgqw"]
Jul 09 09:34:46.289730 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:46.289704    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc900c443_365b_4ddd_bbdf_b71345f75ed1.slice/crio-b29ddb6be55e4a09f1a34a351d5a1dbb5e0819be90f9bc1deb7f2da9035ff494 WatchSource:0}: Error finding container b29ddb6be55e4a09f1a34a351d5a1dbb5e0819be90f9bc1deb7f2da9035ff494: Status 404 returned error can't find the container with id b29ddb6be55e4a09f1a34a351d5a1dbb5e0819be90f9bc1deb7f2da9035ff494
Jul 09 09:34:46.833324 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.833281    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d474fd9-nwgqw" event={"ID":"c900c443-365b-4ddd-bbdf-b71345f75ed1","Type":"ContainerStarted","Data":"b29ddb6be55e4a09f1a34a351d5a1dbb5e0819be90f9bc1deb7f2da9035ff494"}
Jul 09 09:34:46.894447 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.894413    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"]
Jul 09 09:34:46.896787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.896765    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:46.899498 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.899466    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 09:34:46.900199 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.900161    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tp8b5\""
Jul 09 09:34:46.900309 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.900171    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 09:34:46.907319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.907066    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k9bfl"]
Jul 09 09:34:46.909778 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.909759    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.911835 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.911776    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"]
Jul 09 09:34:46.914056 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.913682    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 09:34:46.914056 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.913804    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 09:34:46.914056 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.913835    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gclbm\""
Jul 09 09:34:46.914056 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.913952    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 09:34:46.923094 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.923075    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"]
Jul 09 09:34:46.925552 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.925534    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:46.927768 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.927745    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 09:34:46.928302 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.928005    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 09:34:46.928302 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.928142    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 09:34:46.928302 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.928239    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-drv65\""
Jul 09 09:34:46.938727 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.938683    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"]
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968631    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqtst\" (UniqueName: \"kubernetes.io/projected/d4d89380-65e6-4a2c-a3fd-628df610f43e-kube-api-access-dqtst\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968685    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968713    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-textfile\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968739    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968764    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-tls\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968792    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968820    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d89380-65e6-4a2c-a3fd-628df610f43e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968881    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwz44\" (UniqueName: \"kubernetes.io/projected/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-api-access-hwz44\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968908    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968948    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.968990    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1303b-e086-47e6-924c-f7604015d2ab-metrics-client-ca\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.969019    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4d89380-65e6-4a2c-a3fd-628df610f43e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.969050    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.969077    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-root\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.969244 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.969099    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:46.969958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.969934    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4d89380-65e6-4a2c-a3fd-628df610f43e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:46.970038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.969982    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-sys\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.970038 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.970008    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-wtmp\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:46.970136 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:46.970035    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk586\" (UniqueName: \"kubernetes.io/projected/d2d1303b-e086-47e6-924c-f7604015d2ab-kube-api-access-zk586\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071006 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.070829    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4d89380-65e6-4a2c-a3fd-628df610f43e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.071006 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.070884    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-sys\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071006 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.070913    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-wtmp\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071006 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.070939    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk586\" (UniqueName: \"kubernetes.io/projected/d2d1303b-e086-47e6-924c-f7604015d2ab-kube-api-access-zk586\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071006 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.070978    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqtst\" (UniqueName: \"kubernetes.io/projected/d4d89380-65e6-4a2c-a3fd-628df610f43e-kube-api-access-dqtst\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071018    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-textfile\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071044    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-sys\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071083    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071110    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-tls\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071133    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071164    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d89380-65e6-4a2c-a3fd-628df610f43e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071247    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwz44\" (UniqueName: \"kubernetes.io/projected/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-api-access-hwz44\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071278    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071319    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071364    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1303b-e086-47e6-924c-f7604015d2ab-metrics-client-ca\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071394    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4d89380-65e6-4a2c-a3fd-628df610f43e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.071962 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071436    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.071962 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071465    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-root\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071962 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071502    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-wtmp\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071962 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071534    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2d1303b-e086-47e6-924c-f7604015d2ab-root\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071962 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071785    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-textfile\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.071962 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071863    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.071962 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.071914    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.072318 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:47.071975    2585 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 09 09:34:47.072318 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:47.072039    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-tls podName:4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff nodeName:}" failed. No retries permitted until 2026-07-09 09:34:47.572020984 +0000 UTC m=+65.690380819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-k6gsf" (UID: "4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff") : secret "kube-state-metrics-tls" not found
Jul 09 09:34:47.072318 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.072244    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.072482 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.072465    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.072818 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.072557    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.072818 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:47.072580    2585 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 09:34:47.072818 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:34:47.072790    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-tls podName:d2d1303b-e086-47e6-924c-f7604015d2ab nodeName:}" failed. No retries permitted until 2026-07-09 09:34:47.572760145 +0000 UTC m=+65.691119969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-tls") pod "node-exporter-k9bfl" (UID: "d2d1303b-e086-47e6-924c-f7604015d2ab") : secret "node-exporter-tls" not found
Jul 09 09:34:47.073053 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.073033    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d89380-65e6-4a2c-a3fd-628df610f43e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.073146 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.073123    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2d1303b-e086-47e6-924c-f7604015d2ab-metrics-client-ca\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.074920 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.074900    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4d89380-65e6-4a2c-a3fd-628df610f43e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.075109 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.075090    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4d89380-65e6-4a2c-a3fd-628df610f43e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.076624 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.075550    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.077285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.077255    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.081464 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.081064    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk586\" (UniqueName: \"kubernetes.io/projected/d2d1303b-e086-47e6-924c-f7604015d2ab-kube-api-access-zk586\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.081464 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.081413    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqtst\" (UniqueName: \"kubernetes.io/projected/d4d89380-65e6-4a2c-a3fd-628df610f43e-kube-api-access-dqtst\") pod \"openshift-state-metrics-54cf96dfcf-4dvqp\" (UID: \"d4d89380-65e6-4a2c-a3fd-628df610f43e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.084824 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.084753    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwz44\" (UniqueName: \"kubernetes.io/projected/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-api-access-hwz44\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.208581 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.208536    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"
Jul 09 09:34:47.368408 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.368071    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp"]
Jul 09 09:34:47.372197 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:47.372140    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d89380_65e6_4a2c_a3fd_628df610f43e.slice/crio-b83afe29298dccf45e76d647a9114b4093015616b7a2bf03c3ca93092f5e219c WatchSource:0}: Error finding container b83afe29298dccf45e76d647a9114b4093015616b7a2bf03c3ca93092f5e219c: Status 404 returned error can't find the container with id b83afe29298dccf45e76d647a9114b4093015616b7a2bf03c3ca93092f5e219c
Jul 09 09:34:47.576677 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.576643    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.576861 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.576703    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-tls\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.579605 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.579563    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d1303b-e086-47e6-924c-f7604015d2ab-node-exporter-tls\") pod \"node-exporter-k9bfl\" (UID: \"d2d1303b-e086-47e6-924c-f7604015d2ab\") " pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.579795 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.579749    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k6gsf\" (UID: \"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.821940 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.821893    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9bfl"
Jul 09 09:34:47.834196 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:47.834151    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d1303b_e086_47e6_924c_f7604015d2ab.slice/crio-48e59fad338ba99db15507040b5015b9c088373f1e4f6ebab0fb2f678c27b9bd WatchSource:0}: Error finding container 48e59fad338ba99db15507040b5015b9c088373f1e4f6ebab0fb2f678c27b9bd: Status 404 returned error can't find the container with id 48e59fad338ba99db15507040b5015b9c088373f1e4f6ebab0fb2f678c27b9bd
Jul 09 09:34:47.836680 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.836556    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"
Jul 09 09:34:47.840585 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.840446    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp" event={"ID":"d4d89380-65e6-4a2c-a3fd-628df610f43e","Type":"ContainerStarted","Data":"9d9c4b326566c08468644f76d462eebbefa7a926b010865e4327ddfa903b29c3"}
Jul 09 09:34:47.840585 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.840511    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp" event={"ID":"d4d89380-65e6-4a2c-a3fd-628df610f43e","Type":"ContainerStarted","Data":"e3ac00943b677da5989c4dab81c4b7628e32683a89367853829203252dc223e0"}
Jul 09 09:34:47.840585 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.840540    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp" event={"ID":"d4d89380-65e6-4a2c-a3fd-628df610f43e","Type":"ContainerStarted","Data":"b83afe29298dccf45e76d647a9114b4093015616b7a2bf03c3ca93092f5e219c"}
Jul 09 09:34:47.987271 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.986862    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:34:47.991306 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.991282    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:47.995830 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.995017    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 09:34:47.995830 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.995310    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gxqk2\""
Jul 09 09:34:47.995830 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.995461    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 09:34:47.997082 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.996222    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 09:34:47.997082 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.996563    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 09:34:47.997082 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.996749    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 09:34:47.997082 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.996951    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 09:34:47.997082 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.996975    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 09:34:47.997411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:47.997114    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 09:34:48.004479 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.004432    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 09:34:48.024375 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.024141    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf"]
Jul 09 09:34:48.026099 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.026023    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:34:48.027320 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:48.027290    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5f8d0e_1e21_4a53_bb9f_fc17a199d8ff.slice/crio-f448af90ed004061f38e500ea0894286df4a73c537953cfd55007cde2e4d51f6 WatchSource:0}: Error finding container f448af90ed004061f38e500ea0894286df4a73c537953cfd55007cde2e4d51f6: Status 404 returned error can't find the container with id f448af90ed004061f38e500ea0894286df4a73c537953cfd55007cde2e4d51f6
Jul 09 09:34:48.081963 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.081792    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.081963 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.081834    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gdmq\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-kube-api-access-5gdmq\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.081963 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.081865    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.081963 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.081890    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.081963 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.081953    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082008    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082071    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-web-config\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082126    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082191    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082237    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082262    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082315    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082356 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082358    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:48.082749 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082389    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.082749 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.082433    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-out\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.087553 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.086734    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 09:34:48.087553 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.087092    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 09:34:48.087553 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.087354    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 09:34:48.096541 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.096496    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/294a299b-397e-431f-bc41-2e95b263e091-metrics-certs\") pod \"network-metrics-daemon-nvq9w\" (UID: \"294a299b-397e-431f-bc41-2e95b263e091\") " pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:48.096693 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.096602    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 09:34:48.097679 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.097633    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b2f1a17-546c-4814-be44-ae594f9a1752-original-pull-secret\") pod \"global-pull-secret-syncer-skqw5\" (UID: \"6b2f1a17-546c-4814-be44-ae594f9a1752\") " pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:48.107465 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.107418    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdcr7\" (UniqueName: \"kubernetes.io/projected/5c104045-fe61-4062-abbd-10c3fd4866d7-kube-api-access-gdcr7\") pod \"network-check-target-v5t9z\" (UID: \"5c104045-fe61-4062-abbd-10c3fd4866d7\") " pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183224    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183277    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gdmq\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-kube-api-access-5gdmq\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183310    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183333    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183379    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183413    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183439    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-web-config\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.183540 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.183464    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.184740 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.184484    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7trk\""
Jul 09 09:34:48.185319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.184815    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.185319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.184864    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.185319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.184891    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.185319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.184939    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.185319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.184985    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-out\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.185825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.185765    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.186890 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.186609    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.187869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.187845    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.189655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.189633    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.192077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.191936    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:34:48.192077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.191979    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-web-config\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.192077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.192014    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.192296 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.192165    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-out\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.192640 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.192616    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.193288 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.192818    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skqw5"
Jul 09 09:34:48.193288 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.192948    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.193564 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.193385    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.194623 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.194597    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.196355 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.196317    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.202956 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.202894    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gdmq\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-kube-api-access-5gdmq\") pod \"alertmanager-main-0\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.203912 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.203733    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ntnhc\""
Jul 09 09:34:48.212338 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.211948    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvq9w"
Jul 09 09:34:48.304974 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.304701    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:34:48.391290 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.391155    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v5t9z"]
Jul 09 09:34:48.424996 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.424771    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skqw5"]
Jul 09 09:34:48.429243 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:48.429169    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2f1a17_546c_4814_be44_ae594f9a1752.slice/crio-4a1a3cd54172a5123eaac9bdd61bc8182584592bb1cb6b7be378eb4329198ec6 WatchSource:0}: Error finding container 4a1a3cd54172a5123eaac9bdd61bc8182584592bb1cb6b7be378eb4329198ec6: Status 404 returned error can't find the container with id 4a1a3cd54172a5123eaac9bdd61bc8182584592bb1cb6b7be378eb4329198ec6
Jul 09 09:34:48.438247 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.438155    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvq9w"]
Jul 09 09:34:48.441537 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:48.441357    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294a299b_397e_431f_bc41_2e95b263e091.slice/crio-ec725e1b962baa3ab5bd721e8a8c79ba988f9f676c5451362aa96942a980ca33 WatchSource:0}: Error finding container ec725e1b962baa3ab5bd721e8a8c79ba988f9f676c5451362aa96942a980ca33: Status 404 returned error can't find the container with id ec725e1b962baa3ab5bd721e8a8c79ba988f9f676c5451362aa96942a980ca33
Jul 09 09:34:48.531839 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.531727    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:34:48.847705 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.847664    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skqw5" event={"ID":"6b2f1a17-546c-4814-be44-ae594f9a1752","Type":"ContainerStarted","Data":"4a1a3cd54172a5123eaac9bdd61bc8182584592bb1cb6b7be378eb4329198ec6"}
Jul 09 09:34:48.850045 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.850014    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v5t9z" event={"ID":"5c104045-fe61-4062-abbd-10c3fd4866d7","Type":"ContainerStarted","Data":"ff2865ee9b1217e8415c66e571a275d684e9a07d24c07d071cc87f0b952fe1eb"}
Jul 09 09:34:48.851808 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.851724    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9bfl" event={"ID":"d2d1303b-e086-47e6-924c-f7604015d2ab","Type":"ContainerStarted","Data":"48e59fad338ba99db15507040b5015b9c088373f1e4f6ebab0fb2f678c27b9bd"}
Jul 09 09:34:48.853083 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.853038    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvq9w" event={"ID":"294a299b-397e-431f-bc41-2e95b263e091","Type":"ContainerStarted","Data":"ec725e1b962baa3ab5bd721e8a8c79ba988f9f676c5451362aa96942a980ca33"}
Jul 09 09:34:48.855471 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.855446    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf" event={"ID":"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff","Type":"ContainerStarted","Data":"f448af90ed004061f38e500ea0894286df4a73c537953cfd55007cde2e4d51f6"}
Jul 09 09:34:48.963832 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.963575    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"]
Jul 09 09:34:48.966965 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.966937    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:48.970872 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.970146    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 09:34:48.970872 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.970319    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 09:34:48.970872 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.970464    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 09:34:48.970872 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.970533    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4cb7b\""
Jul 09 09:34:48.970872 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.970703    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 09:34:48.970872 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.970739    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fssgr6p26osct\""
Jul 09 09:34:48.971256 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.970914    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 09:34:48.984526 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:48.984446    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"]
Jul 09 09:34:49.114300 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114219    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgrp5\" (UniqueName: \"kubernetes.io/projected/afb3978f-5084-4a40-b10f-7f2441c29b9d-kube-api-access-vgrp5\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.114300 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114264    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.114300 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114296    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afb3978f-5084-4a40-b10f-7f2441c29b9d-metrics-client-ca\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.114566 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114372    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-tls\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.114566 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114432    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.114566 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114513    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-grpc-tls\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.114566 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114557    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.114747 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.114592    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215542 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215508    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215550    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-grpc-tls\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215587    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215613    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215664    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgrp5\" (UniqueName: \"kubernetes.io/projected/afb3978f-5084-4a40-b10f-7f2441c29b9d-kube-api-access-vgrp5\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215696    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215720    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afb3978f-5084-4a40-b10f-7f2441c29b9d-metrics-client-ca\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.215979 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.215747    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-tls\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.217153 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.217124    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afb3978f-5084-4a40-b10f-7f2441c29b9d-metrics-client-ca\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.218984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.218729    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-tls\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.218984 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.218803    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.219650 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.219585    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.219752 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.219730    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-grpc-tls\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.219883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.219858    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.220120 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.220099    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/afb3978f-5084-4a40-b10f-7f2441c29b9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.225586 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.225545    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgrp5\" (UniqueName: \"kubernetes.io/projected/afb3978f-5084-4a40-b10f-7f2441c29b9d-kube-api-access-vgrp5\") pod \"thanos-querier-85dd8f7bcf-p8vw4\" (UID: \"afb3978f-5084-4a40-b10f-7f2441c29b9d\") " pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.326039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.325749    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:34:49.808547 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:49.808450    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wrxt4"
Jul 09 09:34:50.108413 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:34:50.108343    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7452d304_d45a_4863_8ff3_4b4dc486fae4.slice/crio-593f093f5b8d77b2ab580fc251548dae88b80086f65036412bfb0b5b584fb2f9 WatchSource:0}: Error finding container 593f093f5b8d77b2ab580fc251548dae88b80086f65036412bfb0b5b584fb2f9: Status 404 returned error can't find the container with id 593f093f5b8d77b2ab580fc251548dae88b80086f65036412bfb0b5b584fb2f9
Jul 09 09:34:50.867124 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:50.867086    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerStarted","Data":"593f093f5b8d77b2ab580fc251548dae88b80086f65036412bfb0b5b584fb2f9"}
Jul 09 09:34:51.214034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.214002    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66f4b65746-xzst4"]
Jul 09 09:34:51.218219 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.217710    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.223418 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.221472    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 09:34:51.223418 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.221692    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b59h4\""
Jul 09 09:34:51.223418 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.221896    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 09:34:51.226969 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.224053    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 09:34:51.226969 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.224266    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-drkbqc1o5aano\""
Jul 09 09:34:51.229946 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.229355    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 09:34:51.232340 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.232322    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f4b65746-xzst4"]
Jul 09 09:34:51.335531 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.335498    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29975419-87a3-4d24-aba4-865a710348d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.335706 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.335543    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/29975419-87a3-4d24-aba4-865a710348d4-metrics-server-audit-profiles\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.335706 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.335578    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fnn2\" (UniqueName: \"kubernetes.io/projected/29975419-87a3-4d24-aba4-865a710348d4-kube-api-access-6fnn2\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.335706 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.335693    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-client-ca-bundle\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.335883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.335748    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/29975419-87a3-4d24-aba4-865a710348d4-audit-log\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.335883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.335790    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-secret-metrics-server-tls\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.335883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.335824    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-secret-metrics-server-client-certs\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.436463 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.436432    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/29975419-87a3-4d24-aba4-865a710348d4-audit-log\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.436644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.436475    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-secret-metrics-server-tls\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.436644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.436512    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-secret-metrics-server-client-certs\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.436644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.436571    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29975419-87a3-4d24-aba4-865a710348d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.436644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.436596    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/29975419-87a3-4d24-aba4-865a710348d4-metrics-server-audit-profiles\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.436644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.436621    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fnn2\" (UniqueName: \"kubernetes.io/projected/29975419-87a3-4d24-aba4-865a710348d4-kube-api-access-6fnn2\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.436899 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.436663    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-client-ca-bundle\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.437529 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.437456    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/29975419-87a3-4d24-aba4-865a710348d4-audit-log\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.439153 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.438592    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/29975419-87a3-4d24-aba4-865a710348d4-metrics-server-audit-profiles\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.439153 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.439100    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29975419-87a3-4d24-aba4-865a710348d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.440194 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.440155    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-secret-metrics-server-tls\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.440867 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.440847    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-client-ca-bundle\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.441841 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.441814    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/29975419-87a3-4d24-aba4-865a710348d4-secret-metrics-server-client-certs\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.448363 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.448321    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fnn2\" (UniqueName: \"kubernetes.io/projected/29975419-87a3-4d24-aba4-865a710348d4-kube-api-access-6fnn2\") pod \"metrics-server-66f4b65746-xzst4\" (UID: \"29975419-87a3-4d24-aba4-865a710348d4\") " pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.534191 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.534082    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:34:51.649091 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.649058    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"]
Jul 09 09:34:51.653818 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.653153    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:51.655677 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.655514    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 09:34:51.655677 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.655577    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pcqnf\""
Jul 09 09:34:51.660460 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.660404    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"]
Jul 09 09:34:51.740138 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.740107    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvjvf\" (UniqueName: \"kubernetes.io/projected/267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6-kube-api-access-cvjvf\") pod \"monitoring-plugin-d5dcff7cf-d6qmx\" (UID: \"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:51.740325 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.740161    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-d6qmx\" (UID: \"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:51.841895 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.841192    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-d6qmx\" (UID: \"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:51.841895 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.841380    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvjvf\" (UniqueName: \"kubernetes.io/projected/267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6-kube-api-access-cvjvf\") pod \"monitoring-plugin-d5dcff7cf-d6qmx\" (UID: \"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:51.846218 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.846137    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-d6qmx\" (UID: \"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:51.850161 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.850125    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvjvf\" (UniqueName: \"kubernetes.io/projected/267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6-kube-api-access-cvjvf\") pod \"monitoring-plugin-d5dcff7cf-d6qmx\" (UID: \"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:51.969325 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:51.969085    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:34:53.275573 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.275531    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:34:53.281030 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.281005    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.284015 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.283991    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 09:34:53.284130 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.284057    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 09:34:53.284260 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.284239    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 09:34:53.285011 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.284652    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 09:34:53.285011 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.284686    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 09:34:53.285011 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.284652    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 09:34:53.285250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.285103    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3blbodilbr5h4\""
Jul 09 09:34:53.285513 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.285339    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 09:34:53.285513 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.285391    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 09:34:53.285513 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.285397    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 09:34:53.285723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.285618    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 09:34:53.286734 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.286205    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 09:34:53.286734 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.286230    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 09:34:53.287339 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.287121    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 09:34:53.287339 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.287146    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rlb2t\""
Jul 09 09:34:53.288411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.288392    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 09:34:53.299596 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.299568    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:34:53.356095 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356059    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356095 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356097    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356128    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvz2\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-kube-api-access-8lvz2\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356159    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356249    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356308    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356331    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356360    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356406    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356437    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356474    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356496    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356553    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356584    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.356619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356608    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.357000 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356641    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.357000 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356665    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.357000 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356689    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.357000 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356772    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.357000 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.356824    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458367 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458329    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458549 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458374    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458549 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458393    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458676 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458541    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvz2\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-kube-api-access-8lvz2\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458676 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458600    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458676 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458632    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458676 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458662    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458690    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458722    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458750    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458786    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458824    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.458869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458851    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458895    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458931    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458956    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.458994    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.459023    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.459051    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.459074    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.459111    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459628 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.459167    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.459628 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.459591    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.460458 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.460286    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.460571 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.460542    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.462161 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.462138    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.462682 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.462657    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.463457 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.463394    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.463853 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.463799    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.464485 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.464463    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.464565 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.464468    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.465078 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.465055    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.465189 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.465153    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.467411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.467388    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.467976 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.467934    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.468069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.468033    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.468132 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.468068    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.468227 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.468137    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.469399 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.469354    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.471686 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.471665    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvz2\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-kube-api-access-8lvz2\") pod \"prometheus-k8s-0\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:34:53.594886 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:34:53.594789    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:35:00.422393 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:00.422360    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"]
Jul 09 09:35:02.583784 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:35:02.583500    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb3978f_5084_4a40_b10f_7f2441c29b9d.slice/crio-06a1b374fec4e14b0b342ca71a2ee82152749591f170880b10101af0539a1a5c WatchSource:0}: Error finding container 06a1b374fec4e14b0b342ca71a2ee82152749591f170880b10101af0539a1a5c: Status 404 returned error can't find the container with id 06a1b374fec4e14b0b342ca71a2ee82152749591f170880b10101af0539a1a5c
Jul 09 09:35:02.703601 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:02.703572    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f4b65746-xzst4"]
Jul 09 09:35:02.736376 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:02.736288    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:35:02.870360 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:35:02.870330    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29975419_87a3_4d24_aba4_865a710348d4.slice/crio-f8783e8f7338499593196d21c8a03a6b294c88771e2922b9438cbff341716dc9 WatchSource:0}: Error finding container f8783e8f7338499593196d21c8a03a6b294c88771e2922b9438cbff341716dc9: Status 404 returned error can't find the container with id f8783e8f7338499593196d21c8a03a6b294c88771e2922b9438cbff341716dc9
Jul 09 09:35:02.918676 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:02.918647    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4" event={"ID":"29975419-87a3-4d24-aba4-865a710348d4","Type":"ContainerStarted","Data":"f8783e8f7338499593196d21c8a03a6b294c88771e2922b9438cbff341716dc9"}
Jul 09 09:35:02.919960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:02.919934    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" event={"ID":"afb3978f-5084-4a40-b10f-7f2441c29b9d","Type":"ContainerStarted","Data":"06a1b374fec4e14b0b342ca71a2ee82152749591f170880b10101af0539a1a5c"}
Jul 09 09:35:02.974660 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:35:02.974633    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb3db25_d646_40f9_a172_27d8d7ee2c6b.slice/crio-d99c1053c621bec2c06def36311a63bd59cb6bcca8c519b98c56c88f9c895ef6 WatchSource:0}: Error finding container d99c1053c621bec2c06def36311a63bd59cb6bcca8c519b98c56c88f9c895ef6: Status 404 returned error can't find the container with id d99c1053c621bec2c06def36311a63bd59cb6bcca8c519b98c56c88f9c895ef6
Jul 09 09:35:02.983644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:02.983620    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"]
Jul 09 09:35:02.987571 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:35:02.987533    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267e6d1b_4bcc_4bc1_b7a1_0ef34ed7ffd6.slice/crio-d3da5ed2970a978751cd731a98151631802f3e9a4883a9e5ceff0a08b1a1382e WatchSource:0}: Error finding container d3da5ed2970a978751cd731a98151631802f3e9a4883a9e5ceff0a08b1a1382e: Status 404 returned error can't find the container with id d3da5ed2970a978751cd731a98151631802f3e9a4883a9e5ceff0a08b1a1382e
Jul 09 09:35:03.930033 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.929063    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v5t9z" event={"ID":"5c104045-fe61-4062-abbd-10c3fd4866d7","Type":"ContainerStarted","Data":"00043a75c1ec8cf41a4870da8a840fed88b1070a834c5b645ac80f1325945a99"}
Jul 09 09:35:03.930033 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.929970    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:35:03.934257 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.933867    2585 generic.go:356] "Generic (PLEG): container finished" podID="d2d1303b-e086-47e6-924c-f7604015d2ab" containerID="5515bb87238644d0e315e4f326e6041edfaa63ad1b878b5fbe110da5bd5ed960" exitCode=0
Jul 09 09:35:03.934257 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.933955    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9bfl" event={"ID":"d2d1303b-e086-47e6-924c-f7604015d2ab","Type":"ContainerDied","Data":"5515bb87238644d0e315e4f326e6041edfaa63ad1b878b5fbe110da5bd5ed960"}
Jul 09 09:35:03.943295 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.943240    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d474fd9-nwgqw" event={"ID":"c900c443-365b-4ddd-bbdf-b71345f75ed1","Type":"ContainerStarted","Data":"0f12d46a42362ef55e4bdad3642e322e876273a9cc6ae99052261bdc3a73bd79"}
Jul 09 09:35:03.949154 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.948842    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v5t9z" podStartSLOduration=66.345461979 podStartE2EDuration="1m20.948823789s" totalImagesPullingTime="14.60336181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:03.948559913 +0000 UTC m=+82.066919747" watchObservedRunningTime="2026-07-09 09:35:03.948823789 +0000 UTC m=+82.067183613"
Jul 09 09:35:03.951442 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.950879    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvq9w" event={"ID":"294a299b-397e-431f-bc41-2e95b263e091","Type":"ContainerStarted","Data":"16bb2581faf5c27ba91ca4045594b8d93292f5314a6246953479b2b22344e746"}
Jul 09 09:35:03.951442 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.950928    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvq9w" event={"ID":"294a299b-397e-431f-bc41-2e95b263e091","Type":"ContainerStarted","Data":"fe8479afc72e2729f32fafcc2c6f3dccd1956b4c8e268a98e29efd2dac3cd4c3"}
Jul 09 09:35:03.956332 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.956305    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf" event={"ID":"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff","Type":"ContainerStarted","Data":"212c2050d59200c004cdb201a76d15de10690f8b54c893d9483107c62e9ea32f"}
Jul 09 09:35:03.956496 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.956477    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf" event={"ID":"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff","Type":"ContainerStarted","Data":"6d5e99772ed67b0be0fc507350f8b444a8cd64cfcc4e54a1b670bc40e5a8006e"}
Jul 09 09:35:03.956748 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.956730    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf" event={"ID":"4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff","Type":"ContainerStarted","Data":"58d9bd2eef9756a618f3ef3925b4423a9c97e778888e02932570fa9830198d9f"}
Jul 09 09:35:03.959646 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.959562    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp" event={"ID":"d4d89380-65e6-4a2c-a3fd-628df610f43e","Type":"ContainerStarted","Data":"022cac2bf42d5f7a2788ca9b5012de183b380dae84d54d3ce407ba8ffc6dc587"}
Jul 09 09:35:03.964874 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.964813    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skqw5" event={"ID":"6b2f1a17-546c-4814-be44-ae594f9a1752","Type":"ContainerStarted","Data":"24f88eafdf30112ff02f92fe814d43670f394dda85ac5243e18d3225db84bf60"}
Jul 09 09:35:03.971557 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.971353    2585 generic.go:356] "Generic (PLEG): container finished" podID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d" exitCode=0
Jul 09 09:35:03.974589 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.974562    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"}
Jul 09 09:35:03.974659 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.974634    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerStarted","Data":"d99c1053c621bec2c06def36311a63bd59cb6bcca8c519b98c56c88f9c895ef6"}
Jul 09 09:35:03.981319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.980429    2585 generic.go:356] "Generic (PLEG): container finished" podID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerID="c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e" exitCode=0
Jul 09 09:35:03.981319 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.980524    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e"}
Jul 09 09:35:03.985258 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.984946    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-j5m2p" event={"ID":"d8b57aa2-ca85-4d76-ab3f-7807db131fdb","Type":"ContainerStarted","Data":"3b689d4f7a12214ced145780648220a5320383b6ecaacc359c39d2316ce8ed9a"}
Jul 09 09:35:03.985258 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.985217    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-j5m2p"
Jul 09 09:35:03.987388 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.987313    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx" event={"ID":"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6","Type":"ContainerStarted","Data":"d3da5ed2970a978751cd731a98151631802f3e9a4883a9e5ceff0a08b1a1382e"}
Jul 09 09:35:03.998051 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.997219    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-579d474fd9-nwgqw" podStartSLOduration=5.001231158 podStartE2EDuration="18.997201439s" totalImagesPullingTime="13.995970281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:03.974380904 +0000 UTC m=+82.092740736" watchObservedRunningTime="2026-07-09 09:35:03.997201439 +0000 UTC m=+82.115561266"
Jul 09 09:35:03.998428 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:03.998389    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-j5m2p"
Jul 09 09:35:04.059368 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:04.058538    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k6gsf" podStartSLOduration=5.804145246 podStartE2EDuration="18.058517864s" totalImagesPullingTime="12.254372618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:04.020541571 +0000 UTC m=+82.138901404" watchObservedRunningTime="2026-07-09 09:35:04.058517864 +0000 UTC m=+82.176877697"
Jul 09 09:35:04.087898 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:04.087801    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-skqw5" podStartSLOduration=66.499221594 podStartE2EDuration="1m21.087778242s" totalImagesPullingTime="14.588556648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:04.086262564 +0000 UTC m=+82.204622399" watchObservedRunningTime="2026-07-09 09:35:04.087778242 +0000 UTC m=+82.206138076"
Jul 09 09:35:04.158936 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:04.157373    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nvq9w" podStartSLOduration=66.575583525 podStartE2EDuration="1m21.157345923s" totalImagesPullingTime="14.581762398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:04.155649388 +0000 UTC m=+82.274009221" watchObservedRunningTime="2026-07-09 09:35:04.157345923 +0000 UTC m=+82.275705758"
Jul 09 09:35:04.189118 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:04.189029    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-j5m2p" podStartSLOduration=4.49408251 podStartE2EDuration="28.189009812s" totalImagesPullingTime="23.694927302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:04.187501906 +0000 UTC m=+82.305861739" watchObservedRunningTime="2026-07-09 09:35:04.189009812 +0000 UTC m=+82.307369645"
Jul 09 09:35:04.278682 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:04.278073    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4dvqp" podStartSLOduration=5.497346277 podStartE2EDuration="18.278050184s" totalImagesPullingTime="12.780703907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:04.235675061 +0000 UTC m=+82.354034894" watchObservedRunningTime="2026-07-09 09:35:04.278050184 +0000 UTC m=+82.396410017"
Jul 09 09:35:05.015815 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:05.015776    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9bfl" event={"ID":"d2d1303b-e086-47e6-924c-f7604015d2ab","Type":"ContainerStarted","Data":"d30f0c448849246f68ad4793b7ac1a2ad6ca3d9258950d2df2f4d531abc6c7fb"}
Jul 09 09:35:05.016353 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:05.015844    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9bfl" event={"ID":"d2d1303b-e086-47e6-924c-f7604015d2ab","Type":"ContainerStarted","Data":"f875fdc13c532471dc608a2ecf28a55fe5c05eb34e6c271821006122dac69628"}
Jul 09 09:35:05.044151 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:05.044097    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k9bfl" podStartSLOduration=6.461431177 podStartE2EDuration="19.044080392s" totalImagesPullingTime="12.450932056s" totalInitContainerRuntime="131.717159ms" isStatefulPod=true podCreationTimestamp="2026-07-09 09:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:05.042604722 +0000 UTC m=+83.160964560" watchObservedRunningTime="2026-07-09 09:35:05.044080392 +0000 UTC m=+83.162440215"
Jul 09 09:35:06.143818 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:06.141978    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:35:06.144522 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:06.144455    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:35:06.149039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:06.148827    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:35:06.163293 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:06.163163    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579d474fd9-nwgqw"]
Jul 09 09:35:07.032365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:07.032152    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:35:09.081130 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:09.081102    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7452d304-d45a-4863-8ff3-4b4dc486fae4/init-config-reloader/0.log"
Jul 09 09:35:10.042642 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.042564    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx" event={"ID":"267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6","Type":"ContainerStarted","Data":"a2df2e3869f026352bba8a77c8059f8205e054fdf9816559c2defad31b3fe18b"}
Jul 09 09:35:10.043197 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.043149    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:35:10.044657 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.044584    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4" event={"ID":"29975419-87a3-4d24-aba4-865a710348d4","Type":"ContainerStarted","Data":"51707439f10d130a1e6bc90e4a107bf687aca61fe6eca19404060dde29cabca7"}
Jul 09 09:35:10.046589 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.046562    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" event={"ID":"afb3978f-5084-4a40-b10f-7f2441c29b9d","Type":"ContainerStarted","Data":"beb3af46adf3de1bb63fbe3d402e280d65363b03eccf22959d774e6cf063eee7"}
Jul 09 09:35:10.049145 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.049120    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerStarted","Data":"372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a"}
Jul 09 09:35:10.049919 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.049901    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx"
Jul 09 09:35:10.060663 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.060616    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-d6qmx" podStartSLOduration=12.346718263 podStartE2EDuration="19.06060104s" totalImagesPullingTime="6.713882777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:10.05957163 +0000 UTC m=+88.177931465" watchObservedRunningTime="2026-07-09 09:35:10.06060104 +0000 UTC m=+88.178960872"
Jul 09 09:35:10.100633 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.100570    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4" podStartSLOduration=12.343200724 podStartE2EDuration="19.100547353s" totalImagesPullingTime="6.757346629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:10.09951833 +0000 UTC m=+88.217878163" watchObservedRunningTime="2026-07-09 09:35:10.100547353 +0000 UTC m=+88.218907187"
Jul 09 09:35:10.346317 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.345775    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k6gsf_4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff/kube-state-metrics/0.log"
Jul 09 09:35:10.541770 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.540510    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k6gsf_4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff/kube-rbac-proxy-main/0.log"
Jul 09 09:35:10.739608 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.739489    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k6gsf_4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff/kube-rbac-proxy-self/0.log"
Jul 09 09:35:10.939261 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:10.939235    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66f4b65746-xzst4_29975419-87a3-4d24-aba4-865a710348d4/metrics-server/0.log"
Jul 09 09:35:11.059478 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.059402    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" event={"ID":"afb3978f-5084-4a40-b10f-7f2441c29b9d","Type":"ContainerStarted","Data":"288abc5099e8ad33eeb7583f303ad7007e244452a1d10a141f513a87d3d83ff0"}
Jul 09 09:35:11.059717 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.059663    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" event={"ID":"afb3978f-5084-4a40-b10f-7f2441c29b9d","Type":"ContainerStarted","Data":"298e4d516c23dbf6945b430e23ebfe58c1ef4a4361e7c1ce7458f6f452b2f5ea"}
Jul 09 09:35:11.064835 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.064798    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerStarted","Data":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"}
Jul 09 09:35:11.064952 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.064866    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerStarted","Data":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"}
Jul 09 09:35:11.064952 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.064908    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerStarted","Data":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"}
Jul 09 09:35:11.064952 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.064947    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerStarted","Data":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"}
Jul 09 09:35:11.065170 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.064988    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerStarted","Data":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"}
Jul 09 09:35:11.065170 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.065029    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerStarted","Data":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"}
Jul 09 09:35:11.069660 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.069582    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerStarted","Data":"4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9"}
Jul 09 09:35:11.069773 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.069667    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerStarted","Data":"a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1"}
Jul 09 09:35:11.069844 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.069775    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerStarted","Data":"9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c"}
Jul 09 09:35:11.069844 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.069833    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerStarted","Data":"a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37"}
Jul 09 09:35:11.099282 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.099161    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=11.876057467 podStartE2EDuration="18.099139719s" totalImagesPullingTime="6.167105738s" totalInitContainerRuntime="55.976514ms" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:11.095718571 +0000 UTC m=+89.214078637" watchObservedRunningTime="2026-07-09 09:35:11.099139719 +0000 UTC m=+89.217499553"
Jul 09 09:35:11.139908 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.139835    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-d6qmx_267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6/monitoring-plugin/0.log"
Jul 09 09:35:11.535091 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.535052    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:35:11.535357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.535130    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:35:11.940908 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:11.940886    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9bfl_d2d1303b-e086-47e6-924c-f7604015d2ab/init-textfile/0.log"
Jul 09 09:35:12.075806 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:12.075778    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" event={"ID":"afb3978f-5084-4a40-b10f-7f2441c29b9d","Type":"ContainerStarted","Data":"2bf1a8070aba3a843adac5d433038ce0d225b3fd14d7d25d0b30267614e7fcf9"}
Jul 09 09:35:12.079107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:12.079080    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerStarted","Data":"b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab"}
Jul 09 09:35:12.106564 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:12.106520    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.150082964 podStartE2EDuration="25.106505943s" totalImagesPullingTime="19.915117525s" totalInitContainerRuntime="41.305454ms" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:12.105415378 +0000 UTC m=+90.223775224" watchObservedRunningTime="2026-07-09 09:35:12.106505943 +0000 UTC m=+90.224865774"
Jul 09 09:35:12.140772 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:12.140751    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9bfl_d2d1303b-e086-47e6-924c-f7604015d2ab/node-exporter/0.log"
Jul 09 09:35:12.339596 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:12.339515    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9bfl_d2d1303b-e086-47e6-924c-f7604015d2ab/kube-rbac-proxy/0.log"
Jul 09 09:35:13.086419 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.086383    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" event={"ID":"afb3978f-5084-4a40-b10f-7f2441c29b9d","Type":"ContainerStarted","Data":"12cc44df662db613c7a2c21a87ba7d5e4812af8a5cf6260ace0f20e75f6d8649"}
Jul 09 09:35:13.086596 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.086454    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" event={"ID":"afb3978f-5084-4a40-b10f-7f2441c29b9d","Type":"ContainerStarted","Data":"54de5afdea957060a5a5a3c47e5f8b46ad03840fa8f10a67f8fc83234f7e3d70"}
Jul 09 09:35:13.086832 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.086814    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:35:13.110144 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.110092    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4" podStartSLOduration=16.682616928 podStartE2EDuration="25.110077828s" totalImagesPullingTime="8.4274609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:34:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:35:13.108079542 +0000 UTC m=+91.226439387" watchObservedRunningTime="2026-07-09 09:35:13.110077828 +0000 UTC m=+91.228437660"
Jul 09 09:35:13.140942 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.140909    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4dvqp_d4d89380-65e6-4a2c-a3fd-628df610f43e/kube-rbac-proxy-main/0.log"
Jul 09 09:35:13.339231 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.339142    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4dvqp_d4d89380-65e6-4a2c-a3fd-628df610f43e/kube-rbac-proxy-self/0.log"
Jul 09 09:35:13.539709 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.539683    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4dvqp_d4d89380-65e6-4a2c-a3fd-628df610f43e/openshift-state-metrics/0.log"
Jul 09 09:35:13.595882 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.595819    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:35:13.740510 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.740477    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb3db25-d646-40f9-a172-27d8d7ee2c6b/init-config-reloader/0.log"
Jul 09 09:35:13.940517 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:13.940489    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb3db25-d646-40f9-a172-27d8d7ee2c6b/prometheus/0.log"
Jul 09 09:35:14.142967 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:14.142922    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb3db25-d646-40f9-a172-27d8d7ee2c6b/config-reloader/0.log"
Jul 09 09:35:14.341037 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:14.340966    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb3db25-d646-40f9-a172-27d8d7ee2c6b/thanos-sidecar/0.log"
Jul 09 09:35:14.539965 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:14.539936    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb3db25-d646-40f9-a172-27d8d7ee2c6b/kube-rbac-proxy-web/0.log"
Jul 09 09:35:14.743837 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:14.743803    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb3db25-d646-40f9-a172-27d8d7ee2c6b/kube-rbac-proxy/0.log"
Jul 09 09:35:14.940725 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:14.940700    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb3db25-d646-40f9-a172-27d8d7ee2c6b/kube-rbac-proxy-thanos/0.log"
Jul 09 09:35:15.140358 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:15.140334    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9vh9l_e25c210e-0a03-4695-981e-831e4f004bfc/prometheus-operator/0.log"
Jul 09 09:35:15.339724 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:15.339699    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9vh9l_e25c210e-0a03-4695-981e-831e4f004bfc/kube-rbac-proxy/0.log"
Jul 09 09:35:15.539721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:15.539648    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6xrpk_75b703dc-9bec-4df0-97cc-1d692388046b/prometheus-operator-admission-webhook/0.log"
Jul 09 09:35:15.739978 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:15.739955    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/thanos-query/0.log"
Jul 09 09:35:15.939514 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:15.939485    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy-web/0.log"
Jul 09 09:35:16.140171 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:16.140141    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy/0.log"
Jul 09 09:35:16.339977 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:16.339906    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/prom-label-proxy/0.log"
Jul 09 09:35:16.539886 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:16.539859    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy-rules/0.log"
Jul 09 09:35:16.740200 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:16.740158    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy-metrics/0.log"
Jul 09 09:35:17.540452 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:17.540427    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-579d474fd9-nwgqw_c900c443-365b-4ddd-bbdf-b71345f75ed1/console/0.log"
Jul 09 09:35:17.941541 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:17.941513    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-j5m2p_d8b57aa2-ca85-4d76-ab3f-7807db131fdb/download-server/0.log"
Jul 09 09:35:19.096651 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:19.096624    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85dd8f7bcf-p8vw4"
Jul 09 09:35:31.539774 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:31.539713    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:35:31.543471 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:31.543451    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66f4b65746-xzst4"
Jul 09 09:35:33.054778 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.054731    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-579d474fd9-nwgqw" podUID="c900c443-365b-4ddd-bbdf-b71345f75ed1" containerName="console" containerID="cri-o://0f12d46a42362ef55e4bdad3642e322e876273a9cc6ae99052261bdc3a73bd79" gracePeriod=15
Jul 09 09:35:33.172355 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.172326    2585 generic.go:356] "Generic (PLEG): container finished" podID="c900c443-365b-4ddd-bbdf-b71345f75ed1" containerID="0f12d46a42362ef55e4bdad3642e322e876273a9cc6ae99052261bdc3a73bd79" exitCode=0
Jul 09 09:35:33.172484 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.172395    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d474fd9-nwgqw" event={"ID":"c900c443-365b-4ddd-bbdf-b71345f75ed1","Type":"ContainerDied","Data":"0f12d46a42362ef55e4bdad3642e322e876273a9cc6ae99052261bdc3a73bd79"}
Jul 09 09:35:33.324345 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.324284    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:35:33.457070 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457039    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-oauth-config\") pod \"c900c443-365b-4ddd-bbdf-b71345f75ed1\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") "
Jul 09 09:35:33.457245 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457079    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-oauth-serving-cert\") pod \"c900c443-365b-4ddd-bbdf-b71345f75ed1\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") "
Jul 09 09:35:33.457245 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457108    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmhhd\" (UniqueName: \"kubernetes.io/projected/c900c443-365b-4ddd-bbdf-b71345f75ed1-kube-api-access-wmhhd\") pod \"c900c443-365b-4ddd-bbdf-b71345f75ed1\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") "
Jul 09 09:35:33.457245 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457159    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-config\") pod \"c900c443-365b-4ddd-bbdf-b71345f75ed1\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") "
Jul 09 09:35:33.457245 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457207    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-service-ca\") pod \"c900c443-365b-4ddd-bbdf-b71345f75ed1\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") "
Jul 09 09:35:33.457245 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457237    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-serving-cert\") pod \"c900c443-365b-4ddd-bbdf-b71345f75ed1\" (UID: \"c900c443-365b-4ddd-bbdf-b71345f75ed1\") "
Jul 09 09:35:33.457652 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457620    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-config" (OuterVolumeSpecName: "console-config") pod "c900c443-365b-4ddd-bbdf-b71345f75ed1" (UID: "c900c443-365b-4ddd-bbdf-b71345f75ed1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:35:33.457761 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457625    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c900c443-365b-4ddd-bbdf-b71345f75ed1" (UID: "c900c443-365b-4ddd-bbdf-b71345f75ed1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:35:33.457761 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.457662    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-service-ca" (OuterVolumeSpecName: "service-ca") pod "c900c443-365b-4ddd-bbdf-b71345f75ed1" (UID: "c900c443-365b-4ddd-bbdf-b71345f75ed1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:35:33.459585 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.459563    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c900c443-365b-4ddd-bbdf-b71345f75ed1" (UID: "c900c443-365b-4ddd-bbdf-b71345f75ed1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:35:33.459663 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.459599    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c900c443-365b-4ddd-bbdf-b71345f75ed1-kube-api-access-wmhhd" (OuterVolumeSpecName: "kube-api-access-wmhhd") pod "c900c443-365b-4ddd-bbdf-b71345f75ed1" (UID: "c900c443-365b-4ddd-bbdf-b71345f75ed1"). InnerVolumeSpecName "kube-api-access-wmhhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:35:33.459663 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.459641    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c900c443-365b-4ddd-bbdf-b71345f75ed1" (UID: "c900c443-365b-4ddd-bbdf-b71345f75ed1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:35:33.558725 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.558686    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-config\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:35:33.558725 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.558721    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-service-ca\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:35:33.558725 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.558730    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-serving-cert\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:35:33.558725 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.558739    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c900c443-365b-4ddd-bbdf-b71345f75ed1-console-oauth-config\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:35:33.558941 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.558748    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c900c443-365b-4ddd-bbdf-b71345f75ed1-oauth-serving-cert\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:35:33.558941 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:33.558757    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmhhd\" (UniqueName: \"kubernetes.io/projected/c900c443-365b-4ddd-bbdf-b71345f75ed1-kube-api-access-wmhhd\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:35:34.178005 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:34.177968    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d474fd9-nwgqw" event={"ID":"c900c443-365b-4ddd-bbdf-b71345f75ed1","Type":"ContainerDied","Data":"b29ddb6be55e4a09f1a34a351d5a1dbb5e0819be90f9bc1deb7f2da9035ff494"}
Jul 09 09:35:34.178005 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:34.178002    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d474fd9-nwgqw"
Jul 09 09:35:34.178521 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:34.178033    2585 scope.go:117] "RemoveContainer" containerID="0f12d46a42362ef55e4bdad3642e322e876273a9cc6ae99052261bdc3a73bd79"
Jul 09 09:35:34.199593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:34.199567    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579d474fd9-nwgqw"]
Jul 09 09:35:34.201581 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:34.201562    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-579d474fd9-nwgqw"]
Jul 09 09:35:34.472572 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:34.472499    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c900c443-365b-4ddd-bbdf-b71345f75ed1" path="/var/lib/kubelet/pods/c900c443-365b-4ddd-bbdf-b71345f75ed1/volumes"
Jul 09 09:35:36.023169 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:36.023141    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v5t9z"
Jul 09 09:35:53.595395 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:53.595361    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:35:53.647877 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:53.647847    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:35:54.269358 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:35:54.269333    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:07.363705 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:07.363670    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:36:07.364139 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:07.363995    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="alertmanager" containerID="cri-o://372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a" gracePeriod=120
Jul 09 09:36:07.364139 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:07.364043    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-metric" containerID="cri-o://4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9" gracePeriod=120
Jul 09 09:36:07.364289 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:07.364117    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="prom-label-proxy" containerID="cri-o://b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab" gracePeriod=120
Jul 09 09:36:07.364345 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:07.364269    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="config-reloader" containerID="cri-o://a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37" gracePeriod=120
Jul 09 09:36:07.364345 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:07.364306    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy" containerID="cri-o://a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1" gracePeriod=120
Jul 09 09:36:07.364451 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:07.364303    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-web" containerID="cri-o://9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c" gracePeriod=120
Jul 09 09:36:08.316671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316635    2585 generic.go:356] "Generic (PLEG): container finished" podID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerID="b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab" exitCode=0
Jul 09 09:36:08.316671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316660    2585 generic.go:356] "Generic (PLEG): container finished" podID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerID="4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9" exitCode=0
Jul 09 09:36:08.316671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316667    2585 generic.go:356] "Generic (PLEG): container finished" podID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerID="a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1" exitCode=0
Jul 09 09:36:08.316671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316673    2585 generic.go:356] "Generic (PLEG): container finished" podID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerID="a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37" exitCode=0
Jul 09 09:36:08.316671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316679    2585 generic.go:356] "Generic (PLEG): container finished" podID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerID="372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a" exitCode=0
Jul 09 09:36:08.317024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316707    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab"}
Jul 09 09:36:08.317024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316786    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9"}
Jul 09 09:36:08.317024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316825    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1"}
Jul 09 09:36:08.317024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316859    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37"}
Jul 09 09:36:08.317024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.316898    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a"}
Jul 09 09:36:08.608293 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.608267    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:08.757407 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757374    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-web\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757407 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757413    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-out\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757432    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-metrics-client-ca\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757460    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-tls-assets\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757491    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757510    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-main-db\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757533    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-main-tls\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757574    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-web-config\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757599    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-trusted-ca-bundle\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.757655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757624    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-cluster-tls-config\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.758048 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757666    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.758048 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757689    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gdmq\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-kube-api-access-5gdmq\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.758048 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757737    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-volume\") pod \"7452d304-d45a-4863-8ff3-4b4dc486fae4\" (UID: \"7452d304-d45a-4863-8ff3-4b4dc486fae4\") "
Jul 09 09:36:08.758048 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757836    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:08.758048 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.757886    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:36:08.758330 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.758136    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-metrics-client-ca\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.758330 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.758134    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:08.758330 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.758159    2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-main-db\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.760804 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.760772    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:08.760804 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.760780    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-kube-api-access-5gdmq" (OuterVolumeSpecName: "kube-api-access-5gdmq") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "kube-api-access-5gdmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:36:08.760804 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.760774    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-out" (OuterVolumeSpecName: "config-out") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:36:08.761036 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.760868    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:08.761220 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.761162    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:36:08.761309 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.761256    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:08.761366 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.761344    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:08.762542 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.762519    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-volume" (OuterVolumeSpecName: "config-volume") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:08.766097 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.766072    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:08.771228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.771202    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-web-config" (OuterVolumeSpecName: "web-config") pod "7452d304-d45a-4863-8ff3-4b4dc486fae4" (UID: "7452d304-d45a-4863-8ff3-4b4dc486fae4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859337    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859364    2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-out\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859373    2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-tls-assets\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859381    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859390    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-main-tls\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859401    2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-web-config\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859409    2585 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7452d304-d45a-4863-8ff3-4b4dc486fae4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859411 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859417    2585 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-cluster-tls-config\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859734 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859425    2585 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859734 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859434    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gdmq\" (UniqueName: \"kubernetes.io/projected/7452d304-d45a-4863-8ff3-4b4dc486fae4-kube-api-access-5gdmq\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:08.859734 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:08.859442    2585 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7452d304-d45a-4863-8ff3-4b4dc486fae4-config-volume\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:09.323538 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.323508    2585 generic.go:356] "Generic (PLEG): container finished" podID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerID="9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c" exitCode=0
Jul 09 09:36:09.323733 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.323573    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c"}
Jul 09 09:36:09.323733 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.323589    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.323733 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.323679    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7452d304-d45a-4863-8ff3-4b4dc486fae4","Type":"ContainerDied","Data":"593f093f5b8d77b2ab580fc251548dae88b80086f65036412bfb0b5b584fb2f9"}
Jul 09 09:36:09.323733 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.323726    2585 scope.go:117] "RemoveContainer" containerID="b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab"
Jul 09 09:36:09.331963 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.331844    2585 scope.go:117] "RemoveContainer" containerID="4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9"
Jul 09 09:36:09.338904 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.338886    2585 scope.go:117] "RemoveContainer" containerID="a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1"
Jul 09 09:36:09.345560 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.345474    2585 scope.go:117] "RemoveContainer" containerID="9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c"
Jul 09 09:36:09.348047 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.348027    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:36:09.352196 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.352161    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:36:09.353484 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.353470    2585 scope.go:117] "RemoveContainer" containerID="a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37"
Jul 09 09:36:09.360044 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.360027    2585 scope.go:117] "RemoveContainer" containerID="372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a"
Jul 09 09:36:09.366703 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.366686    2585 scope.go:117] "RemoveContainer" containerID="c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e"
Jul 09 09:36:09.373425 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.373407    2585 scope.go:117] "RemoveContainer" containerID="b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab"
Jul 09 09:36:09.373698 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:09.373673    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab\": container with ID starting with b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab not found: ID does not exist" containerID="b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab"
Jul 09 09:36:09.373748 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.373705    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab"} err="failed to get container status \"b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab\": rpc error: code = NotFound desc = could not find container \"b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab\": container with ID starting with b9582e87701eb0a786a8cae68f99351effe5e5e9edb235ddc3199f5f0101ffab not found: ID does not exist"
Jul 09 09:36:09.373748 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.373735    2585 scope.go:117] "RemoveContainer" containerID="4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9"
Jul 09 09:36:09.373966 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:09.373949    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9\": container with ID starting with 4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9 not found: ID does not exist" containerID="4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9"
Jul 09 09:36:09.374008 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.373972    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9"} err="failed to get container status \"4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9\": rpc error: code = NotFound desc = could not find container \"4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9\": container with ID starting with 4e38266f419708597a29b835e1cc361ea1546c0dd4deb799f7627dad0d1ed9f9 not found: ID does not exist"
Jul 09 09:36:09.374008 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.373987    2585 scope.go:117] "RemoveContainer" containerID="a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1"
Jul 09 09:36:09.374215 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:09.374200    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1\": container with ID starting with a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1 not found: ID does not exist" containerID="a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1"
Jul 09 09:36:09.374273 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374219    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1"} err="failed to get container status \"a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1\": rpc error: code = NotFound desc = could not find container \"a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1\": container with ID starting with a50487679f1d8a01bea945f1f1074f4c022bcf7206cb1712bfaeef003990d7d1 not found: ID does not exist"
Jul 09 09:36:09.374273 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374233    2585 scope.go:117] "RemoveContainer" containerID="9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c"
Jul 09 09:36:09.374450 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:09.374435    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c\": container with ID starting with 9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c not found: ID does not exist" containerID="9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c"
Jul 09 09:36:09.374495 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374452    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c"} err="failed to get container status \"9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c\": rpc error: code = NotFound desc = could not find container \"9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c\": container with ID starting with 9a987c32c87701da4b86850eea0260f910b7c8c5c71da54047ebdefca5539e4c not found: ID does not exist"
Jul 09 09:36:09.374495 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374463    2585 scope.go:117] "RemoveContainer" containerID="a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37"
Jul 09 09:36:09.374668 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:09.374653    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37\": container with ID starting with a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37 not found: ID does not exist" containerID="a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37"
Jul 09 09:36:09.374707 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374672    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37"} err="failed to get container status \"a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37\": rpc error: code = NotFound desc = could not find container \"a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37\": container with ID starting with a220da0545ad7d16652378f8dc72fe00580192e665982dcd8e5db049a6f65f37 not found: ID does not exist"
Jul 09 09:36:09.374707 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374685    2585 scope.go:117] "RemoveContainer" containerID="372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a"
Jul 09 09:36:09.374856 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:09.374843    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a\": container with ID starting with 372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a not found: ID does not exist" containerID="372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a"
Jul 09 09:36:09.374897 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374859    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a"} err="failed to get container status \"372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a\": rpc error: code = NotFound desc = could not find container \"372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a\": container with ID starting with 372199b11dabbfa9f593e8d6f2d60cdc42192d1441e7f66f1a7ce5f2c6c7ba2a not found: ID does not exist"
Jul 09 09:36:09.374897 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.374873    2585 scope.go:117] "RemoveContainer" containerID="c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e"
Jul 09 09:36:09.375039 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:09.375026    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e\": container with ID starting with c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e not found: ID does not exist" containerID="c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e"
Jul 09 09:36:09.375074 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.375042    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e"} err="failed to get container status \"c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e\": rpc error: code = NotFound desc = could not find container \"c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e\": container with ID starting with c5557b05a21fa49c54ffbdc4899f9e42a204731b41dec2619c2c121d9fc76a4e not found: ID does not exist"
Jul 09 09:36:09.381114 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381094    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:36:09.381399 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381387    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c900c443-365b-4ddd-bbdf-b71345f75ed1" containerName="console"
Jul 09 09:36:09.381446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381401    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c900c443-365b-4ddd-bbdf-b71345f75ed1" containerName="console"
Jul 09 09:36:09.381446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381409    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="init-config-reloader"
Jul 09 09:36:09.381446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381415    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="init-config-reloader"
Jul 09 09:36:09.381446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381427    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-metric"
Jul 09 09:36:09.381446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381432    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-metric"
Jul 09 09:36:09.381446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381441    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="config-reloader"
Jul 09 09:36:09.381446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381447    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="config-reloader"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381454    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="prom-label-proxy"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381459    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="prom-label-proxy"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381473    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-web"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381478    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-web"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381489    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="alertmanager"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381495    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="alertmanager"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381501    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381506    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381545    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="alertmanager"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381554    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381562    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="prom-label-proxy"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381568    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="config-reloader"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381574    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-metric"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381580    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c900c443-365b-4ddd-bbdf-b71345f75ed1" containerName="console"
Jul 09 09:36:09.381654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.381585    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" containerName="kube-rbac-proxy-web"
Jul 09 09:36:09.385562 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.385545    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.388929 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.388221    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 09:36:09.388929 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.388706    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 09:36:09.389723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.389375    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 09:36:09.389723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.389581    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 09:36:09.389723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.389594    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 09:36:09.389723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.389623    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 09:36:09.389723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.389655    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 09:36:09.389723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.389667    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gxqk2\""
Jul 09 09:36:09.390048 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.389994    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 09:36:09.394219 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.394205    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 09:36:09.398737 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.398632    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:36:09.464642 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-config-volume\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464783 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464649    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464783 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464678    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464783 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464723    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464783 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464760    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464940 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464792    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl725\" (UniqueName: \"kubernetes.io/projected/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-kube-api-access-rl725\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464940 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464809    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464940 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464829    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464940 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464870    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.464940 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464896    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-config-out\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.465105 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464948    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.465105 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.464967    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.465105 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.465011    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-web-config\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.565883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.565850    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.565883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.565884    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566050 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.565911    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-web-config\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566050 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.565970    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-config-volume\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566050 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566015    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566168 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566050    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566168 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566081    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566168 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566108    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566344 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566221    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl725\" (UniqueName: \"kubernetes.io/projected/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-kube-api-access-rl725\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566344 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566258    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566344 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566290    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566344 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566327    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566537 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566379    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-config-out\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.566537 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.566512    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.567521 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.567172    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569281 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.568953    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569281 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.568953    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569281 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.568988    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-config-out\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569281 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.569060    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-config-volume\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569281 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.569068    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-web-config\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569607 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.569298    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569607 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.569583    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569841 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.569821    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.569900 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.569884    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.571042 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.571018    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.576954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.576905    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl725\" (UniqueName: \"kubernetes.io/projected/e570b3a3-75b2-4b35-8f3f-55a55e6cd419-kube-api-access-rl725\") pod \"alertmanager-main-0\" (UID: \"e570b3a3-75b2-4b35-8f3f-55a55e6cd419\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.697362 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.697334    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 09:36:09.836762 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:09.832896    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 09:36:10.330053 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:10.330021    2585 generic.go:356] "Generic (PLEG): container finished" podID="e570b3a3-75b2-4b35-8f3f-55a55e6cd419" containerID="21f6850313ca336482bcbdeab07c76299900c7d29c41ae5e4ca649b98935d9d5" exitCode=0
Jul 09 09:36:10.330242 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:10.330065    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerDied","Data":"21f6850313ca336482bcbdeab07c76299900c7d29c41ae5e4ca649b98935d9d5"}
Jul 09 09:36:10.330242 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:10.330117    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerStarted","Data":"8fdf921547be79111e1ecde482c3e9f52c0b3cbaad98792b5b29f8f853d81890"}
Jul 09 09:36:10.472590 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:10.472499    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7452d304-d45a-4863-8ff3-4b4dc486fae4" path="/var/lib/kubelet/pods/7452d304-d45a-4863-8ff3-4b4dc486fae4/volumes"
Jul 09 09:36:11.339757 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.339715    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerStarted","Data":"3d0dc1cdd9a82f1dc145efce462c6a804fb5b8b308525f5b01d9d2f3a4874818"}
Jul 09 09:36:11.340228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.339833    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerStarted","Data":"59e64c7b8a50adfc235badd7848179ac7b4856bf48cebe5e817216cc5d78cd25"}
Jul 09 09:36:11.340228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.339870    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerStarted","Data":"14fcb187bd9996f464569b9742fd92eed9426b5394be2e2fbef871dd956f1c6b"}
Jul 09 09:36:11.340228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.339910    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerStarted","Data":"d549e7a46c9c4da7250a691e09c5eb8cab834973575d274c58dbc883de67845c"}
Jul 09 09:36:11.340228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.339948    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerStarted","Data":"91123433065ca0dc79736f8d4737ff9c0d01ce5148d302643ac60420ff9adc45"}
Jul 09 09:36:11.340228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.339984    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e570b3a3-75b2-4b35-8f3f-55a55e6cd419","Type":"ContainerStarted","Data":"1634a892ea241832e6bcb4e1fc5383a2dcbf256c59ea5dac44daae583d2edd77"}
Jul 09 09:36:11.368283 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.368218    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.349208975 podStartE2EDuration="2.36819514s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.986165ms" isStatefulPod=false podCreationTimestamp="2026-07-09 09:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:36:11.36629547 +0000 UTC m=+149.484655303" watchObservedRunningTime="2026-07-09 09:36:11.36819514 +0000 UTC m=+149.486554973"
Jul 09 09:36:11.707647 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.707612    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:36:11.708160 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.707991    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="thanos-sidecar" containerID="cri-o://f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5" gracePeriod=600
Jul 09 09:36:11.708160 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.707992    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy" containerID="cri-o://7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d" gracePeriod=600
Jul 09 09:36:11.708160 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.707952    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="prometheus" containerID="cri-o://68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8" gracePeriod=600
Jul 09 09:36:11.708160 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.708033    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="config-reloader" containerID="cri-o://894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937" gracePeriod=600
Jul 09 09:36:11.708160 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.708028    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-web" containerID="cri-o://db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4" gracePeriod=600
Jul 09 09:36:11.708160 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.708005    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6" gracePeriod=600
Jul 09 09:36:11.952134 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:11.951270    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.087669 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087583    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-1\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.087669 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087617    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-metrics-client-ca\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.087669 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087636    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.087669 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087651    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-web-config\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.087669 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087672    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-tls\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087810    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-kubelet-serving-ca-bundle\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087871    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.087983    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:12.088039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088014    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-kube-rbac-proxy\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088059    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-serving-certs-ca-bundle\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088093    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-thanos-prometheus-http-client-file\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088094    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088123    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-trusted-ca-bundle\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088161    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-db\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088214    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088233    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-0\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088263 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088263    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088294    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-metrics-client-certs\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088341    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lvz2\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-kube-api-access-8lvz2\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088370    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config-out\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088386    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:12.088638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088393    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-grpc-tls\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088448    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-tls-assets\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088484    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-2\") pod \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\" (UID: \"7cb3db25-d646-40f9-a172-27d8d7ee2c6b\") "
Jul 09 09:36:12.088998 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088795    2585 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.088998 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088816    2585 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.088998 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088833    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.088998 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.088848    2585 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-configmap-metrics-client-ca\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.089209 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.089100    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:12.090612 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.090344    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:12.090728 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.090620    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:36:12.091987 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.091790    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.091987 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.091953    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:36:12.092290 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.092258    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.092683 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.092650    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:36:12.092777 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.092679    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.092838 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.092791    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.092881 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.092855    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config-out" (OuterVolumeSpecName: "config-out") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:36:12.092921 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.092893    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.093046 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.093027    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.093079 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.093067    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config" (OuterVolumeSpecName: "config") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.093323 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.093304    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-kube-api-access-8lvz2" (OuterVolumeSpecName: "kube-api-access-8lvz2") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "kube-api-access-8lvz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:36:12.093385 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.093370    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.101619 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.101596    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-web-config" (OuterVolumeSpecName: "web-config") pod "7cb3db25-d646-40f9-a172-27d8d7ee2c6b" (UID: "7cb3db25-d646-40f9-a172-27d8d7ee2c6b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:36:12.189985 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.189959    2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.189985 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.189982    2585 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-kube-rbac-proxy\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.189985 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.189992    2585 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190003    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190012    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-db\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190022    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190031    2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190039    2585 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-metrics-client-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190047    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lvz2\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-kube-api-access-8lvz2\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190055    2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config-out\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190062    2585 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-grpc-tls\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190070    2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-tls-assets\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190077    2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190085    2585 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-config\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190092    2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-web-config\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.190229 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.190100    2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb3db25-d646-40f9-a172-27d8d7ee2c6b-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:36:12.347285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347202    2585 generic.go:356] "Generic (PLEG): container finished" podID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6" exitCode=0
Jul 09 09:36:12.347285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347226    2585 generic.go:356] "Generic (PLEG): container finished" podID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d" exitCode=0
Jul 09 09:36:12.347285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347235    2585 generic.go:356] "Generic (PLEG): container finished" podID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4" exitCode=0
Jul 09 09:36:12.347285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347242    2585 generic.go:356] "Generic (PLEG): container finished" podID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5" exitCode=0
Jul 09 09:36:12.347285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347249    2585 generic.go:356] "Generic (PLEG): container finished" podID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937" exitCode=0
Jul 09 09:36:12.347285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347255    2585 generic.go:356] "Generic (PLEG): container finished" podID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8" exitCode=0
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347291    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347285    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"}
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347421    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"}
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347451    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"}
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347475    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"}
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347494    2585 scope.go:117] "RemoveContainer" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347500    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"}
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347525    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"}
Jul 09 09:36:12.347888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.347549    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb3db25-d646-40f9-a172-27d8d7ee2c6b","Type":"ContainerDied","Data":"d99c1053c621bec2c06def36311a63bd59cb6bcca8c519b98c56c88f9c895ef6"}
Jul 09 09:36:12.357891 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.357852    2585 scope.go:117] "RemoveContainer" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.365195 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.365164    2585 scope.go:117] "RemoveContainer" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.376589 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.376560    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:36:12.377024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.376998    2585 scope.go:117] "RemoveContainer" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.379657 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.379636    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:36:12.384286 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.384259    2585 scope.go:117] "RemoveContainer" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.391387 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.391368    2585 scope.go:117] "RemoveContainer" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.399524 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.399509    2585 scope.go:117] "RemoveContainer" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.405480 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405463    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:36:12.405818 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405800    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-thanos"
Jul 09 09:36:12.405818 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405819    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-thanos"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405837    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="init-config-reloader"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405843    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="init-config-reloader"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405856    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-web"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405862    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-web"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405876    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="thanos-sidecar"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405883    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="thanos-sidecar"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405893    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="prometheus"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405900    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="prometheus"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405907    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="config-reloader"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405912    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="config-reloader"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405918    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy"
Jul 09 09:36:12.405958 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405922    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy"
Jul 09 09:36:12.406436 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405972    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-thanos"
Jul 09 09:36:12.406436 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405984    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy"
Jul 09 09:36:12.406436 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.405994    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="prometheus"
Jul 09 09:36:12.406436 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.406005    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="thanos-sidecar"
Jul 09 09:36:12.406436 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.406014    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="kube-rbac-proxy-web"
Jul 09 09:36:12.406436 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.406022    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" containerName="config-reloader"
Jul 09 09:36:12.407769 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.407753    2585 scope.go:117] "RemoveContainer" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.408019 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:12.407998    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": container with ID starting with c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6 not found: ID does not exist" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.408106 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408027    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"} err="failed to get container status \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": rpc error: code = NotFound desc = could not find container \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": container with ID starting with c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6 not found: ID does not exist"
Jul 09 09:36:12.408106 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408050    2585 scope.go:117] "RemoveContainer" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.408375 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:12.408347    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": container with ID starting with 7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d not found: ID does not exist" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.408445 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408384    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"} err="failed to get container status \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": rpc error: code = NotFound desc = could not find container \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": container with ID starting with 7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d not found: ID does not exist"
Jul 09 09:36:12.408445 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408406    2585 scope.go:117] "RemoveContainer" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.408666 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:12.408645    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": container with ID starting with db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4 not found: ID does not exist" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.408740 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408670    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"} err="failed to get container status \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": rpc error: code = NotFound desc = could not find container \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": container with ID starting with db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4 not found: ID does not exist"
Jul 09 09:36:12.408740 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408690    2585 scope.go:117] "RemoveContainer" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.408927 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:12.408913    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": container with ID starting with f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5 not found: ID does not exist" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.408977 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408930    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"} err="failed to get container status \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": rpc error: code = NotFound desc = could not find container \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": container with ID starting with f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5 not found: ID does not exist"
Jul 09 09:36:12.408977 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.408943    2585 scope.go:117] "RemoveContainer" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.409157 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:12.409143    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": container with ID starting with 894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937 not found: ID does not exist" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.409214 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409161    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"} err="failed to get container status \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": rpc error: code = NotFound desc = could not find container \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": container with ID starting with 894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937 not found: ID does not exist"
Jul 09 09:36:12.409214 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409173    2585 scope.go:117] "RemoveContainer" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.409410 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:12.409396    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": container with ID starting with 68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8 not found: ID does not exist" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.409458 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409413    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"} err="failed to get container status \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": rpc error: code = NotFound desc = could not find container \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": container with ID starting with 68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8 not found: ID does not exist"
Jul 09 09:36:12.409458 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409425    2585 scope.go:117] "RemoveContainer" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.409612 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:36:12.409595    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": container with ID starting with 444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d not found: ID does not exist" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.409708 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409613    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"} err="failed to get container status \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": rpc error: code = NotFound desc = could not find container \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": container with ID starting with 444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d not found: ID does not exist"
Jul 09 09:36:12.409708 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409638    2585 scope.go:117] "RemoveContainer" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.409877 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409861    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"} err="failed to get container status \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": rpc error: code = NotFound desc = could not find container \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": container with ID starting with c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6 not found: ID does not exist"
Jul 09 09:36:12.409945 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.409879    2585 scope.go:117] "RemoveContainer" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.410090 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.410071    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"} err="failed to get container status \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": rpc error: code = NotFound desc = could not find container \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": container with ID starting with 7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d not found: ID does not exist"
Jul 09 09:36:12.410137 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.410091    2585 scope.go:117] "RemoveContainer" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.410171 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.410158    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.410390 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.410365    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"} err="failed to get container status \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": rpc error: code = NotFound desc = could not find container \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": container with ID starting with db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4 not found: ID does not exist"
Jul 09 09:36:12.410475 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.410392    2585 scope.go:117] "RemoveContainer" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.410783 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.410757    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"} err="failed to get container status \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": rpc error: code = NotFound desc = could not find container \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": container with ID starting with f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5 not found: ID does not exist"
Jul 09 09:36:12.410853 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.410785    2585 scope.go:117] "RemoveContainer" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.411031 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411011    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"} err="failed to get container status \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": rpc error: code = NotFound desc = could not find container \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": container with ID starting with 894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937 not found: ID does not exist"
Jul 09 09:36:12.411073 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411034    2585 scope.go:117] "RemoveContainer" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.411293 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411273    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"} err="failed to get container status \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": rpc error: code = NotFound desc = could not find container \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": container with ID starting with 68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8 not found: ID does not exist"
Jul 09 09:36:12.411293 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411292    2585 scope.go:117] "RemoveContainer" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.411523 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411500    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"} err="failed to get container status \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": rpc error: code = NotFound desc = could not find container \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": container with ID starting with 444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d not found: ID does not exist"
Jul 09 09:36:12.411565 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411527    2585 scope.go:117] "RemoveContainer" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.411766 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411749    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"} err="failed to get container status \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": rpc error: code = NotFound desc = could not find container \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": container with ID starting with c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6 not found: ID does not exist"
Jul 09 09:36:12.411825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411767    2585 scope.go:117] "RemoveContainer" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.411957 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411936    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"} err="failed to get container status \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": rpc error: code = NotFound desc = could not find container \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": container with ID starting with 7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d not found: ID does not exist"
Jul 09 09:36:12.412007 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.411960    2585 scope.go:117] "RemoveContainer" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.412219 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412197    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"} err="failed to get container status \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": rpc error: code = NotFound desc = could not find container \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": container with ID starting with db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4 not found: ID does not exist"
Jul 09 09:36:12.412291 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412222    2585 scope.go:117] "RemoveContainer" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.412467 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412443    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"} err="failed to get container status \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": rpc error: code = NotFound desc = could not find container \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": container with ID starting with f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5 not found: ID does not exist"
Jul 09 09:36:12.412560 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412469    2585 scope.go:117] "RemoveContainer" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.412694 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412675    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 09:36:12.412841 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412818    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"} err="failed to get container status \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": rpc error: code = NotFound desc = could not find container \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": container with ID starting with 894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937 not found: ID does not exist"
Jul 09 09:36:12.412928 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412843    2585 scope.go:117] "RemoveContainer" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.412928 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.412875    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 09:36:12.413094 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413075    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 09:36:12.413094 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413079    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"} err="failed to get container status \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": rpc error: code = NotFound desc = could not find container \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": container with ID starting with 68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8 not found: ID does not exist"
Jul 09 09:36:12.413094 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413101    2585 scope.go:117] "RemoveContainer" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.413341 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413308    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 09:36:12.413409 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413352    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 09:36:12.413409 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413360    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 09:36:12.413511 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413428    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"} err="failed to get container status \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": rpc error: code = NotFound desc = could not find container \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": container with ID starting with 444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d not found: ID does not exist"
Jul 09 09:36:12.413511 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413450    2585 scope.go:117] "RemoveContainer" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.413684 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413668    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rlb2t\""
Jul 09 09:36:12.413684 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413672    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"} err="failed to get container status \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": rpc error: code = NotFound desc = could not find container \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": container with ID starting with c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6 not found: ID does not exist"
Jul 09 09:36:12.413767 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413693    2585 scope.go:117] "RemoveContainer" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.413767 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413680    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 09:36:12.413863 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413766    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 09:36:12.413926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413881    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 09:36:12.413926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413913    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"} err="failed to get container status \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": rpc error: code = NotFound desc = could not find container \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": container with ID starting with 7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d not found: ID does not exist"
Jul 09 09:36:12.414053 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413933    2585 scope.go:117] "RemoveContainer" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.414053 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413974    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3blbodilbr5h4\""
Jul 09 09:36:12.414053 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.413985    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 09:36:12.414272 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.414161    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 09:36:12.414443 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.414423    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 09:36:12.414603 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.414579    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"} err="failed to get container status \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": rpc error: code = NotFound desc = could not find container \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": container with ID starting with db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4 not found: ID does not exist"
Jul 09 09:36:12.414700 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.414604    2585 scope.go:117] "RemoveContainer" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.414879 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.414859    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"} err="failed to get container status \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": rpc error: code = NotFound desc = could not find container \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": container with ID starting with f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5 not found: ID does not exist"
Jul 09 09:36:12.414945 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.414880    2585 scope.go:117] "RemoveContainer" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.415174 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.415148    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"} err="failed to get container status \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": rpc error: code = NotFound desc = could not find container \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": container with ID starting with 894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937 not found: ID does not exist"
Jul 09 09:36:12.415281 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.415197    2585 scope.go:117] "RemoveContainer" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.415483 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.415457    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"} err="failed to get container status \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": rpc error: code = NotFound desc = could not find container \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": container with ID starting with 68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8 not found: ID does not exist"
Jul 09 09:36:12.415605 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.415484    2585 scope.go:117] "RemoveContainer" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.415749 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.415708    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"} err="failed to get container status \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": rpc error: code = NotFound desc = could not find container \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": container with ID starting with 444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d not found: ID does not exist"
Jul 09 09:36:12.415796 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.415752    2585 scope.go:117] "RemoveContainer" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.416022 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.415999    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"} err="failed to get container status \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": rpc error: code = NotFound desc = could not find container \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": container with ID starting with c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6 not found: ID does not exist"
Jul 09 09:36:12.416075 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416024    2585 scope.go:117] "RemoveContainer" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.416285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416265    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"} err="failed to get container status \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": rpc error: code = NotFound desc = could not find container \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": container with ID starting with 7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d not found: ID does not exist"
Jul 09 09:36:12.416370 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416285    2585 scope.go:117] "RemoveContainer" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.416545 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416528    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"} err="failed to get container status \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": rpc error: code = NotFound desc = could not find container \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": container with ID starting with db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4 not found: ID does not exist"
Jul 09 09:36:12.416593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416546    2585 scope.go:117] "RemoveContainer" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.416636 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416621    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 09:36:12.416825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416799    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"} err="failed to get container status \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": rpc error: code = NotFound desc = could not find container \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": container with ID starting with f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5 not found: ID does not exist"
Jul 09 09:36:12.416878 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.416827    2585 scope.go:117] "RemoveContainer" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.417083 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417065    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"} err="failed to get container status \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": rpc error: code = NotFound desc = could not find container \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": container with ID starting with 894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937 not found: ID does not exist"
Jul 09 09:36:12.417122 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417085    2585 scope.go:117] "RemoveContainer" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.417387 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417364    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"} err="failed to get container status \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": rpc error: code = NotFound desc = could not find container \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": container with ID starting with 68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8 not found: ID does not exist"
Jul 09 09:36:12.417387 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417387    2585 scope.go:117] "RemoveContainer" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.417645 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417620    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"} err="failed to get container status \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": rpc error: code = NotFound desc = could not find container \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": container with ID starting with 444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d not found: ID does not exist"
Jul 09 09:36:12.417723 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417648    2585 scope.go:117] "RemoveContainer" containerID="c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"
Jul 09 09:36:12.417960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417938    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6"} err="failed to get container status \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": rpc error: code = NotFound desc = could not find container \"c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6\": container with ID starting with c7b53b5ec9562e6f68c904d5e1e5a9695bec0f2cc78587cf1c3555b1204142c6 not found: ID does not exist"
Jul 09 09:36:12.417960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.417960    2585 scope.go:117] "RemoveContainer" containerID="7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"
Jul 09 09:36:12.418250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418229    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d"} err="failed to get container status \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": rpc error: code = NotFound desc = could not find container \"7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d\": container with ID starting with 7d7bc5b62f82923329163d1492cce17f4f16b09c8a019d0bfdafb1af3622138d not found: ID does not exist"
Jul 09 09:36:12.418250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418249    2585 scope.go:117] "RemoveContainer" containerID="db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"
Jul 09 09:36:12.418506 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418486    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4"} err="failed to get container status \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": rpc error: code = NotFound desc = could not find container \"db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4\": container with ID starting with db14c12886e6f0b2af44f2cb459613d16348e214ce77dcae46d81e64e5bf4da4 not found: ID does not exist"
Jul 09 09:36:12.418580 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418508    2585 scope.go:117] "RemoveContainer" containerID="f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"
Jul 09 09:36:12.418759 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418739    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5"} err="failed to get container status \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": rpc error: code = NotFound desc = could not find container \"f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5\": container with ID starting with f573699191e13be0f182d9926b87170c217a8a818491dc150d7c4d023b34e6f5 not found: ID does not exist"
Jul 09 09:36:12.418759 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418758    2585 scope.go:117] "RemoveContainer" containerID="894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"
Jul 09 09:36:12.419067 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418972    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937"} err="failed to get container status \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": rpc error: code = NotFound desc = could not find container \"894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937\": container with ID starting with 894d5bbe5e417e7cc687b1c61ed535dcee8b7fda70590203dc2644f86ac63937 not found: ID does not exist"
Jul 09 09:36:12.419067 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.418994    2585 scope.go:117] "RemoveContainer" containerID="68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"
Jul 09 09:36:12.419297 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.419279    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8"} err="failed to get container status \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": rpc error: code = NotFound desc = could not find container \"68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8\": container with ID starting with 68114339a0fb2763291452ce3bb02b926baddd3aedf3e5205ce2ceea6338b6e8 not found: ID does not exist"
Jul 09 09:36:12.419389 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.419299    2585 scope.go:117] "RemoveContainer" containerID="444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"
Jul 09 09:36:12.419577 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.419550    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d"} err="failed to get container status \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": rpc error: code = NotFound desc = could not find container \"444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d\": container with ID starting with 444ebaee70ccbd407aac4e0cc141da1560bf2e5350cd81ac6596a99858528a1d not found: ID does not exist"
Jul 09 09:36:12.420819 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.420802    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 09:36:12.434231 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.434209    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:36:12.472843 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.472817    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cb3db25-d646-40f9-a172-27d8d7ee2c6b" path="/var/lib/kubelet/pods/7cb3db25-d646-40f9-a172-27d8d7ee2c6b/volumes"
Jul 09 09:36:12.492715 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.492689    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.492785 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.492733    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.492841 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.492807    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.492874 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.492863    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c62s9\" (UniqueName: \"kubernetes.io/projected/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-kube-api-access-c62s9\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.492911 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.492886    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.492911 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.492905    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493037    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493175 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493067    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493175 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493116    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493175 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493162    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-web-config\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493324 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493226    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493324 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493257    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493324 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493307    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-config\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493426 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493372    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493426 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493400    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493516 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493422    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493516 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493445    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493516 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493676 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493586    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.493676 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.493649    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-config-out\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595020 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.594993    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-config\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595164 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595029    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595164 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595047    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595164 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595065    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595164 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595079    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595164 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595096    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595444 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595375    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595444 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595412    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-config-out\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595551 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595448    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595551 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595486    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595551 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595520    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595554    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c62s9\" (UniqueName: \"kubernetes.io/projected/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-kube-api-access-c62s9\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595587    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595615    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595662    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595686    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595935 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595716    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595935 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595744    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-web-config\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595935 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595768    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595935 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595796    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.595935 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595844    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.596171 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.595743    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.596251 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.596206    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.596305 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.596258    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.596374 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.596347    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.597116 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.597090    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.598527 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.598130    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.598527 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.598286    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.598527 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.598509    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-config\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.598712 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.598547    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.598936 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.598913    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-web-config\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.599030 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.599007    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.599234 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.599211    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.599593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.599567    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.599689 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.599604    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-config-out\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.600444 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.600425    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.600807 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.600785    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.600939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.600922    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.601163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.601146    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.603661 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.603645    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c62s9\" (UniqueName: \"kubernetes.io/projected/6dce7fa1-1246-4f9a-a4c0-425f2de41a75-kube-api-access-c62s9\") pod \"prometheus-k8s-0\" (UID: \"6dce7fa1-1246-4f9a-a4c0-425f2de41a75\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.721546 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.721518    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:36:12.853816 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:12.853792    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 09:36:12.856294 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:36:12.856266    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dce7fa1_1246_4f9a_a4c0_425f2de41a75.slice/crio-80fc4dd06f40d63bcc47f79d9c9f1d47af7fa3ced4ef278137e1d01d23dd52cb WatchSource:0}: Error finding container 80fc4dd06f40d63bcc47f79d9c9f1d47af7fa3ced4ef278137e1d01d23dd52cb: Status 404 returned error can't find the container with id 80fc4dd06f40d63bcc47f79d9c9f1d47af7fa3ced4ef278137e1d01d23dd52cb
Jul 09 09:36:13.353785 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:13.353754    2585 generic.go:356] "Generic (PLEG): container finished" podID="6dce7fa1-1246-4f9a-a4c0-425f2de41a75" containerID="a384e1d5452809764132dccd5e76f339b58e21962c39eeffa487daea584817b2" exitCode=0
Jul 09 09:36:13.354269 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:13.353839    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerDied","Data":"a384e1d5452809764132dccd5e76f339b58e21962c39eeffa487daea584817b2"}
Jul 09 09:36:13.354269 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:13.353904    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerStarted","Data":"80fc4dd06f40d63bcc47f79d9c9f1d47af7fa3ced4ef278137e1d01d23dd52cb"}
Jul 09 09:36:14.360797 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:14.360758    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerStarted","Data":"22b6d849505f9ba7f199c21624cf500a3d8a5a9cf5072928ab35f4ae321b7592"}
Jul 09 09:36:14.361226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:14.360878    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerStarted","Data":"a32fdc0dd043553e58a3fcd99abbe7ac8e28c733d2f3c0573078a32b8801c89d"}
Jul 09 09:36:14.361226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:14.360920    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerStarted","Data":"882ac6fda0e6cdd660e95838c989a8aba28fad99dd1c8e4649fa2e4ece7155fd"}
Jul 09 09:36:14.361226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:14.360958    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerStarted","Data":"4338fdcc7180673acfa61dfd0846274cee3b1198a48e030bf27cd9c7084d1a5d"}
Jul 09 09:36:14.361226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:14.360993    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerStarted","Data":"7740b8fbd1dad7a712d5783f8666c26a6b395e1cc5b9b19bb8f82caf4dc5d984"}
Jul 09 09:36:14.361226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:14.361027    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dce7fa1-1246-4f9a-a4c0-425f2de41a75","Type":"ContainerStarted","Data":"b118ec5b5f29b51aea5969fd986cc2b405300ed54e1dbb200776ba29c7113742"}
Jul 09 09:36:14.392041 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:14.391982    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.373420447 podStartE2EDuration="2.391964052s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.543605ms" isStatefulPod=false podCreationTimestamp="2026-07-09 09:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:36:14.389679315 +0000 UTC m=+152.508039149" watchObservedRunningTime="2026-07-09 09:36:14.391964052 +0000 UTC m=+152.510323884"
Jul 09 09:36:17.722680 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:36:17.722647    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:37:12.722139 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:37:12.722110    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:37:12.736426 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:37:12.736400    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:37:13.605870 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:37:13.605845    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 09:38:42.315159 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:38:42.315131    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:38:42.315664 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:38:42.315379    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:38:42.318355 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:38:42.318333    2585 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 09:41:27.581650 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.581622    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cb757cd9b-n89wz"]
Jul 09 09:41:27.583772 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.583754    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.586416 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.586389    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 09:41:27.586512 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.586489    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 09:41:27.587429 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.587410    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qtbkd\""
Jul 09 09:41:27.587533 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.587418    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 09:41:27.587533 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.587502    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 09:41:27.587533 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.587513    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 09:41:27.593303 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.593285    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 09:41:27.601856 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.601838    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb757cd9b-n89wz"]
Jul 09 09:41:27.639735 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.639710    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-trusted-ca-bundle\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.639859 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.639743    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-service-ca\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.639859 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.639767    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdadd270-b08c-483e-bb97-7131e4424daa-console-serving-cert\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.639859 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.639849    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdadd270-b08c-483e-bb97-7131e4424daa-console-oauth-config\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.639965 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.639885    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-console-config\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.639965 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.639902    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-oauth-serving-cert\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.639965 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.639951    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fnvs\" (UniqueName: \"kubernetes.io/projected/bdadd270-b08c-483e-bb97-7131e4424daa-kube-api-access-7fnvs\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.740550 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.740523    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fnvs\" (UniqueName: \"kubernetes.io/projected/bdadd270-b08c-483e-bb97-7131e4424daa-kube-api-access-7fnvs\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.740722 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.740575    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-trusted-ca-bundle\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.740722 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.740602    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-service-ca\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.740722 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.740636    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdadd270-b08c-483e-bb97-7131e4424daa-console-serving-cert\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.740722 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.740685    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdadd270-b08c-483e-bb97-7131e4424daa-console-oauth-config\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.740722 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.740718    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-console-config\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.741001 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.740740    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-oauth-serving-cert\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.741486 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.741448    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-service-ca\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.741616 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.741494    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-console-config\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.741616 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.741564    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-oauth-serving-cert\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.741707 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.741641    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdadd270-b08c-483e-bb97-7131e4424daa-trusted-ca-bundle\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.743272 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.743244    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdadd270-b08c-483e-bb97-7131e4424daa-console-oauth-config\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.743541 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.743520    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdadd270-b08c-483e-bb97-7131e4424daa-console-serving-cert\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.752763 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.752743    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fnvs\" (UniqueName: \"kubernetes.io/projected/bdadd270-b08c-483e-bb97-7131e4424daa-kube-api-access-7fnvs\") pod \"console-cb757cd9b-n89wz\" (UID: \"bdadd270-b08c-483e-bb97-7131e4424daa\") " pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:27.894728 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:27.894700    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:28.038623 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:28.038598    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb757cd9b-n89wz"]
Jul 09 09:41:28.040736 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:41:28.040710    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdadd270_b08c_483e_bb97_7131e4424daa.slice/crio-8f1e7840095c6081fd3e466036a3cd95441ceb5d9d2c12ee718a2f643bfc9b52 WatchSource:0}: Error finding container 8f1e7840095c6081fd3e466036a3cd95441ceb5d9d2c12ee718a2f643bfc9b52: Status 404 returned error can't find the container with id 8f1e7840095c6081fd3e466036a3cd95441ceb5d9d2c12ee718a2f643bfc9b52
Jul 09 09:41:28.586252 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:28.586217    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb757cd9b-n89wz" event={"ID":"bdadd270-b08c-483e-bb97-7131e4424daa","Type":"ContainerStarted","Data":"4318faaaf0e5ed0c8b4328b25afde7fbcddf4ec6dbd582daa755f91c48465345"}
Jul 09 09:41:28.586665 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:28.586265    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb757cd9b-n89wz" event={"ID":"bdadd270-b08c-483e-bb97-7131e4424daa","Type":"ContainerStarted","Data":"8f1e7840095c6081fd3e466036a3cd95441ceb5d9d2c12ee718a2f643bfc9b52"}
Jul 09 09:41:28.617816 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:28.617768    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cb757cd9b-n89wz" podStartSLOduration=1.617752496 podStartE2EDuration="1.617752496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:41:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:41:28.616619341 +0000 UTC m=+466.734979186" watchObservedRunningTime="2026-07-09 09:41:28.617752496 +0000 UTC m=+466.736112330"
Jul 09 09:41:34.494544 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.494512    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mttn4"]
Jul 09 09:41:34.497279 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.497262    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.499803 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.499782    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lpdwp\""
Jul 09 09:41:34.499910 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.499783    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 09:41:34.500926 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.500907    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 09:41:34.510151 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.510119    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mttn4"]
Jul 09 09:41:34.599652 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.599614    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz7qw\" (UniqueName: \"kubernetes.io/projected/e75750cd-e6be-4dcb-8d5e-aae6b2190ec5-kube-api-access-pz7qw\") pod \"cert-manager-webhook-6486ffd997-mttn4\" (UID: \"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.599652 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.599659    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e75750cd-e6be-4dcb-8d5e-aae6b2190ec5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mttn4\" (UID: \"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.700481 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.700431    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz7qw\" (UniqueName: \"kubernetes.io/projected/e75750cd-e6be-4dcb-8d5e-aae6b2190ec5-kube-api-access-pz7qw\") pod \"cert-manager-webhook-6486ffd997-mttn4\" (UID: \"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.700646 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.700501    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e75750cd-e6be-4dcb-8d5e-aae6b2190ec5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mttn4\" (UID: \"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.715172 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.715140    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz7qw\" (UniqueName: \"kubernetes.io/projected/e75750cd-e6be-4dcb-8d5e-aae6b2190ec5-kube-api-access-pz7qw\") pod \"cert-manager-webhook-6486ffd997-mttn4\" (UID: \"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.717196 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.717165    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e75750cd-e6be-4dcb-8d5e-aae6b2190ec5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mttn4\" (UID: \"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.818350 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.818268    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:34.967253 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.967216    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mttn4"]
Jul 09 09:41:34.970577 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:41:34.970552    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode75750cd_e6be_4dcb_8d5e_aae6b2190ec5.slice/crio-6591e8dc0a5491e070d115187d13b46dbb33bc41eb24b61d12a993c821206f3e WatchSource:0}: Error finding container 6591e8dc0a5491e070d115187d13b46dbb33bc41eb24b61d12a993c821206f3e: Status 404 returned error can't find the container with id 6591e8dc0a5491e070d115187d13b46dbb33bc41eb24b61d12a993c821206f3e
Jul 09 09:41:34.972452 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.972436    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 09:41:34.992765 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.992746    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"]
Jul 09 09:41:34.995602 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.995588    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:34.998448 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:34.998431    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zm5w2\""
Jul 09 09:41:35.055471 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.055441    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"]
Jul 09 09:41:35.104593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.104520    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484bfa5d-e202-4518-9cf8-adff6f6263b3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d75cr\" (UID: \"484bfa5d-e202-4518-9cf8-adff6f6263b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:35.104593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.104556    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzhtx\" (UniqueName: \"kubernetes.io/projected/484bfa5d-e202-4518-9cf8-adff6f6263b3-kube-api-access-rzhtx\") pod \"cert-manager-cainjector-559cdd8c87-d75cr\" (UID: \"484bfa5d-e202-4518-9cf8-adff6f6263b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:35.205500 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.205464    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484bfa5d-e202-4518-9cf8-adff6f6263b3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d75cr\" (UID: \"484bfa5d-e202-4518-9cf8-adff6f6263b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:35.205661 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.205505    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzhtx\" (UniqueName: \"kubernetes.io/projected/484bfa5d-e202-4518-9cf8-adff6f6263b3-kube-api-access-rzhtx\") pod \"cert-manager-cainjector-559cdd8c87-d75cr\" (UID: \"484bfa5d-e202-4518-9cf8-adff6f6263b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:35.216037 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.216008    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzhtx\" (UniqueName: \"kubernetes.io/projected/484bfa5d-e202-4518-9cf8-adff6f6263b3-kube-api-access-rzhtx\") pod \"cert-manager-cainjector-559cdd8c87-d75cr\" (UID: \"484bfa5d-e202-4518-9cf8-adff6f6263b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:35.220366 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.220345    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484bfa5d-e202-4518-9cf8-adff6f6263b3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d75cr\" (UID: \"484bfa5d-e202-4518-9cf8-adff6f6263b3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:35.304105 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.304075    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"
Jul 09 09:41:35.445448 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.445425    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d75cr"]
Jul 09 09:41:35.447721 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:41:35.447688    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod484bfa5d_e202_4518_9cf8_adff6f6263b3.slice/crio-3a891fe14e120c3b63f41e80ad2c5e038f9c8f16e34318c25d17de4a827f872c WatchSource:0}: Error finding container 3a891fe14e120c3b63f41e80ad2c5e038f9c8f16e34318c25d17de4a827f872c: Status 404 returned error can't find the container with id 3a891fe14e120c3b63f41e80ad2c5e038f9c8f16e34318c25d17de4a827f872c
Jul 09 09:41:35.618122 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.618089    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4" event={"ID":"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5","Type":"ContainerStarted","Data":"6591e8dc0a5491e070d115187d13b46dbb33bc41eb24b61d12a993c821206f3e"}
Jul 09 09:41:35.619210 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:35.619167    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr" event={"ID":"484bfa5d-e202-4518-9cf8-adff6f6263b3","Type":"ContainerStarted","Data":"3a891fe14e120c3b63f41e80ad2c5e038f9c8f16e34318c25d17de4a827f872c"}
Jul 09 09:41:37.895458 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:37.895429    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:37.895884 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:37.895490    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:37.901089 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:37.901068    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:38.636526 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:38.636488    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr" event={"ID":"484bfa5d-e202-4518-9cf8-adff6f6263b3","Type":"ContainerStarted","Data":"422b1add1545afe2dead23909e0adaa42b5395a3c21084e04569ca37c419b9bc"}
Jul 09 09:41:38.640698 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:38.640674    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cb757cd9b-n89wz"
Jul 09 09:41:38.668561 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:38.668512    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d75cr" podStartSLOduration=1.60292249 podStartE2EDuration="4.668497774s" totalImagesPullingTime="3.065575284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:41:38.666681721 +0000 UTC m=+476.785041553" watchObservedRunningTime="2026-07-09 09:41:38.668497774 +0000 UTC m=+476.786857605"
Jul 09 09:41:47.672362 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.672328    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4" event={"ID":"e75750cd-e6be-4dcb-8d5e-aae6b2190ec5","Type":"ContainerStarted","Data":"474e85b7e9785413942f419a319d0233d0b19429ac6e93c8b43ed1bb593fbe9f"}
Jul 09 09:41:47.672748 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.672441    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:41:47.693855 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.693808    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4" podStartSLOduration=1.553670834 podStartE2EDuration="13.693791889s" totalImagesPullingTime="12.140121055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:41:47.692534287 +0000 UTC m=+485.810894119" watchObservedRunningTime="2026-07-09 09:41:47.693791889 +0000 UTC m=+485.812151721"
Jul 09 09:41:47.755717 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.755686    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"]
Jul 09 09:41:47.758985 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.758964    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:47.761651 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.761629    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 09:41:47.761957 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.761942    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 09:41:47.762093 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.762078    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-52c77\""
Jul 09 09:41:47.769747 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.769728    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"]
Jul 09 09:41:47.918468 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.918436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5593aec1-71c7-4a2a-87c2-5be7cbcc3b04-tmp\") pod \"openshift-lws-operator-fd8ccff4c-559pb\" (UID: \"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:47.918468 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:47.918467    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znwwc\" (UniqueName: \"kubernetes.io/projected/5593aec1-71c7-4a2a-87c2-5be7cbcc3b04-kube-api-access-znwwc\") pod \"openshift-lws-operator-fd8ccff4c-559pb\" (UID: \"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:48.019039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:48.018950    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5593aec1-71c7-4a2a-87c2-5be7cbcc3b04-tmp\") pod \"openshift-lws-operator-fd8ccff4c-559pb\" (UID: \"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:48.019039 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:48.018980    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znwwc\" (UniqueName: \"kubernetes.io/projected/5593aec1-71c7-4a2a-87c2-5be7cbcc3b04-kube-api-access-znwwc\") pod \"openshift-lws-operator-fd8ccff4c-559pb\" (UID: \"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:48.019408 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:48.019388    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5593aec1-71c7-4a2a-87c2-5be7cbcc3b04-tmp\") pod \"openshift-lws-operator-fd8ccff4c-559pb\" (UID: \"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:48.027108 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:48.027088    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znwwc\" (UniqueName: \"kubernetes.io/projected/5593aec1-71c7-4a2a-87c2-5be7cbcc3b04-kube-api-access-znwwc\") pod \"openshift-lws-operator-fd8ccff4c-559pb\" (UID: \"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:48.068080 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:48.068054    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"
Jul 09 09:41:48.195956 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:48.195932    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb"]
Jul 09 09:41:48.198153 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:41:48.198126    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5593aec1_71c7_4a2a_87c2_5be7cbcc3b04.slice/crio-1d74c082ae45fe5a0d2bc64f4385c4f4c26c349c234293387aad81464094aae0 WatchSource:0}: Error finding container 1d74c082ae45fe5a0d2bc64f4385c4f4c26c349c234293387aad81464094aae0: Status 404 returned error can't find the container with id 1d74c082ae45fe5a0d2bc64f4385c4f4c26c349c234293387aad81464094aae0
Jul 09 09:41:48.677643 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:48.677607    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb" event={"ID":"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04","Type":"ContainerStarted","Data":"1d74c082ae45fe5a0d2bc64f4385c4f4c26c349c234293387aad81464094aae0"}
Jul 09 09:41:51.692830 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:51.692789    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb" event={"ID":"5593aec1-71c7-4a2a-87c2-5be7cbcc3b04","Type":"ContainerStarted","Data":"f8b905395440c7a108576dbfeab4b6bfaa0b0853f3a020554286fdb6a6e7e281"}
Jul 09 09:41:51.710776 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:51.710722    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-559pb" podStartSLOduration=1.370726712 podStartE2EDuration="4.710705479s" totalImagesPullingTime="3.339978767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:41:51.709413509 +0000 UTC m=+489.827773338" watchObservedRunningTime="2026-07-09 09:41:51.710705479 +0000 UTC m=+489.829065311"
Jul 09 09:41:53.679986 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:41:53.679960    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mttn4"
Jul 09 09:42:08.240396 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.240356    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"]
Jul 09 09:42:08.284226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.284171    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"]
Jul 09 09:42:08.284382 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.284293    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.287028 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.287006    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 09:42:08.287169 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.287009    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 09:42:08.287640 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.287622    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zjcnv\""
Jul 09 09:42:08.287640 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.287630    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 09:42:08.300403 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.300380    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsp9h\" (UniqueName: \"kubernetes.io/projected/2f4e88e5-7912-445a-a91c-dfd774682419-kube-api-access-dsp9h\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.300485 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.300429    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f4e88e5-7912-445a-a91c-dfd774682419-manager-config\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.300485 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.300474    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4e88e5-7912-445a-a91c-dfd774682419-metrics-cert\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.300576 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.300522    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f4e88e5-7912-445a-a91c-dfd774682419-cert\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.401914 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.401878    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f4e88e5-7912-445a-a91c-dfd774682419-cert\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.402074 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.401932    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsp9h\" (UniqueName: \"kubernetes.io/projected/2f4e88e5-7912-445a-a91c-dfd774682419-kube-api-access-dsp9h\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.402074 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.401966    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f4e88e5-7912-445a-a91c-dfd774682419-manager-config\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.402074 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.401987    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4e88e5-7912-445a-a91c-dfd774682419-metrics-cert\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.402699 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.402672    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f4e88e5-7912-445a-a91c-dfd774682419-manager-config\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.404468 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.404447    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f4e88e5-7912-445a-a91c-dfd774682419-cert\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.404562 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.404477    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f4e88e5-7912-445a-a91c-dfd774682419-metrics-cert\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.411093 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.411075    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsp9h\" (UniqueName: \"kubernetes.io/projected/2f4e88e5-7912-445a-a91c-dfd774682419-kube-api-access-dsp9h\") pod \"lws-controller-manager-599d46c4cb-pkpkn\" (UID: \"2f4e88e5-7912-445a-a91c-dfd774682419\") " pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.594247 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.594159    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:08.741585 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.741551    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"]
Jul 09 09:42:08.743357 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:42:08.743317    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4e88e5_7912_445a_a91c_dfd774682419.slice/crio-1b67651d49647bb124cf698ba6b84620fb0d7d522fd77f03aae25cb464433bdd WatchSource:0}: Error finding container 1b67651d49647bb124cf698ba6b84620fb0d7d522fd77f03aae25cb464433bdd: Status 404 returned error can't find the container with id 1b67651d49647bb124cf698ba6b84620fb0d7d522fd77f03aae25cb464433bdd
Jul 09 09:42:08.770165 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:08.770136    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn" event={"ID":"2f4e88e5-7912-445a-a91c-dfd774682419","Type":"ContainerStarted","Data":"1b67651d49647bb124cf698ba6b84620fb0d7d522fd77f03aae25cb464433bdd"}
Jul 09 09:42:09.431200 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.429730    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"]
Jul 09 09:42:09.432919 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.432897    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.440521 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.440502    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 09:42:09.440697 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.440555    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 09:42:09.440839 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.440586    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-47555\""
Jul 09 09:42:09.448602 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.448581    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 09:42:09.450858 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.450837    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"]
Jul 09 09:42:09.512638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512605    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.512816 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512643    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.512816 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512673    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.512816 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512726    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.512816 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512745    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.512816 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512795    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f7a1dd-03f9-4af1-9911-910e51bd241d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.513052 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512858    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.513052 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512881    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrwf5\" (UniqueName: \"kubernetes.io/projected/82f7a1dd-03f9-4af1-9911-910e51bd241d-kube-api-access-xrwf5\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.513052 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.512916    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613591 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613545    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613767 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613601    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613767 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613630    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613767 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613659    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613767 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613735    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f7a1dd-03f9-4af1-9911-910e51bd241d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613975 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613808    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613975 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613847    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrwf5\" (UniqueName: \"kubernetes.io/projected/82f7a1dd-03f9-4af1-9911-910e51bd241d-kube-api-access-xrwf5\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613975 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613904    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.613975 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.613955    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.614194 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.614069    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-data\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.614194 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.614107    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-workload-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.614317 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.614304    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-credential-socket\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.614371 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.614351    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-workload-certs\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.614941 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.614914    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82f7a1dd-03f9-4af1-9911-910e51bd241d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.616238 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.616217    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-envoy\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.616419 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.616399    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.624102 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.624080    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82f7a1dd-03f9-4af1-9911-910e51bd241d-istio-token\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.624304 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.624277    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrwf5\" (UniqueName: \"kubernetes.io/projected/82f7a1dd-03f9-4af1-9911-910e51bd241d-kube-api-access-xrwf5\") pod \"openshift-ai-inference-openshift-default-655f7c58b4-962b9\" (UID: \"82f7a1dd-03f9-4af1-9911-910e51bd241d\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:09.747329 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:09.747254    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:10.201035 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:10.201011    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"]
Jul 09 09:42:10.202875 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:42:10.202840    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f7a1dd_03f9_4af1_9911_910e51bd241d.slice/crio-b7cb9c851d2ec261c7dbfa8cceb831898deed81842891d81df8cfbae6ef64512 WatchSource:0}: Error finding container b7cb9c851d2ec261c7dbfa8cceb831898deed81842891d81df8cfbae6ef64512: Status 404 returned error can't find the container with id b7cb9c851d2ec261c7dbfa8cceb831898deed81842891d81df8cfbae6ef64512
Jul 09 09:42:10.782687 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:10.782650    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn" event={"ID":"2f4e88e5-7912-445a-a91c-dfd774682419","Type":"ContainerStarted","Data":"3e51e3c6f932181be65f58ea76f85103a0c296d715947dd0cbbd18dd1fb6c072"}
Jul 09 09:42:10.783145 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:10.782816    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:10.783939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:10.783921    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"b7cb9c851d2ec261c7dbfa8cceb831898deed81842891d81df8cfbae6ef64512"}
Jul 09 09:42:10.804750 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:10.804705    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn" podStartSLOduration=1.443131414 podStartE2EDuration="2.804692024s" totalImagesPullingTime="1.36156061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:42:10.804388213 +0000 UTC m=+508.922748061" watchObservedRunningTime="2026-07-09 09:42:10.804692024 +0000 UTC m=+508.923051855"
Jul 09 09:42:12.768389 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:12.768346    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:42:12.768734 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:12.768422    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:42:12.768734 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:12.768454    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:42:13.800757 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:13.800721    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"4728876ada249d4b68e3f85ab2215bcb50804672a5649f85b5e97bb903357fa3"}
Jul 09 09:42:13.824795 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:13.824744    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podStartSLOduration=2.261624452 podStartE2EDuration="4.8247288s" totalImagesPullingTime="2.563104348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:42:13.82389198 +0000 UTC m=+511.942251837" watchObservedRunningTime="2026-07-09 09:42:13.8247288 +0000 UTC m=+511.943088634"
Jul 09 09:42:14.747509 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:14.747479    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:14.752083 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:14.752060    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:14.805446 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:14.805413    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:14.806288 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:14.806271    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:42:21.791660 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:21.791630    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-599d46c4cb-pkpkn"
Jul 09 09:42:40.781054 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.781021    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-xhvv8"]
Jul 09 09:42:40.783633 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.783618    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8"
Jul 09 09:42:40.786163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.786145    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 09:42:40.786412 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.786399    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gg649\""
Jul 09 09:42:40.786855 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.786841    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 09:42:40.798831 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.798811    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-xhvv8"]
Jul 09 09:42:40.895964 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.895930    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cvn\" (UniqueName: \"kubernetes.io/projected/05a35e02-ff9a-4b44-8659-7278ee43818f-kube-api-access-c5cvn\") pod \"authorino-operator-6d85f6564-xhvv8\" (UID: \"05a35e02-ff9a-4b44-8659-7278ee43818f\") " pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8"
Jul 09 09:42:40.997065 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:40.997030    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cvn\" (UniqueName: \"kubernetes.io/projected/05a35e02-ff9a-4b44-8659-7278ee43818f-kube-api-access-c5cvn\") pod \"authorino-operator-6d85f6564-xhvv8\" (UID: \"05a35e02-ff9a-4b44-8659-7278ee43818f\") " pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8"
Jul 09 09:42:41.007052 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:41.007023    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cvn\" (UniqueName: \"kubernetes.io/projected/05a35e02-ff9a-4b44-8659-7278ee43818f-kube-api-access-c5cvn\") pod \"authorino-operator-6d85f6564-xhvv8\" (UID: \"05a35e02-ff9a-4b44-8659-7278ee43818f\") " pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8"
Jul 09 09:42:41.093859 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:41.093774    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8"
Jul 09 09:42:41.264034 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:41.264002    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-xhvv8"]
Jul 09 09:42:41.280579 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:42:41.280551    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a35e02_ff9a_4b44_8659_7278ee43818f.slice/crio-8d1f0713f4040fdcd10431922479e994bfa34accb2724707e190d21fb4b74152 WatchSource:0}: Error finding container 8d1f0713f4040fdcd10431922479e994bfa34accb2724707e190d21fb4b74152: Status 404 returned error can't find the container with id 8d1f0713f4040fdcd10431922479e994bfa34accb2724707e190d21fb4b74152
Jul 09 09:42:41.923445 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:41.923416    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8" event={"ID":"05a35e02-ff9a-4b44-8659-7278ee43818f","Type":"ContainerStarted","Data":"8d1f0713f4040fdcd10431922479e994bfa34accb2724707e190d21fb4b74152"}
Jul 09 09:42:44.940365 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:44.940334    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8" event={"ID":"05a35e02-ff9a-4b44-8659-7278ee43818f","Type":"ContainerStarted","Data":"15d974b2bf220d7adb18bc4089e99fb11060415e3f043e0c13cb440163600852"}
Jul 09 09:42:44.940736 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:44.940446    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8"
Jul 09 09:42:55.946409 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:55.946379    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8"
Jul 09 09:42:55.971433 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:42:55.971386    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-xhvv8" podStartSLOduration=12.740423109 podStartE2EDuration="15.97137076s" totalImagesPullingTime="3.230947651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:42:44.965061393 +0000 UTC m=+543.083421225" watchObservedRunningTime="2026-07-09 09:42:55.97137076 +0000 UTC m=+554.089730592"
Jul 09 09:43:24.724505 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.724475    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-9r2d7"]
Jul 09 09:43:24.733006 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.732984    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:24.735599 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.735578    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 09:43:24.739024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.738773    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rjlwh\""
Jul 09 09:43:24.741008 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.740989    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-9r2d7"]
Jul 09 09:43:24.771438 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.771409    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-9r2d7"]
Jul 09 09:43:24.854624 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.854591    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c3ded68-60b0-4266-a3c1-a5cc1a23f781-config-file\") pod \"limitador-limitador-69574b596d-9r2d7\" (UID: \"2c3ded68-60b0-4266-a3c1-a5cc1a23f781\") " pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:24.854783 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.854673    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhtf\" (UniqueName: \"kubernetes.io/projected/2c3ded68-60b0-4266-a3c1-a5cc1a23f781-kube-api-access-drhtf\") pod \"limitador-limitador-69574b596d-9r2d7\" (UID: \"2c3ded68-60b0-4266-a3c1-a5cc1a23f781\") " pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:24.955577 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.955546    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drhtf\" (UniqueName: \"kubernetes.io/projected/2c3ded68-60b0-4266-a3c1-a5cc1a23f781-kube-api-access-drhtf\") pod \"limitador-limitador-69574b596d-9r2d7\" (UID: \"2c3ded68-60b0-4266-a3c1-a5cc1a23f781\") " pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:24.955731 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.955604    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c3ded68-60b0-4266-a3c1-a5cc1a23f781-config-file\") pod \"limitador-limitador-69574b596d-9r2d7\" (UID: \"2c3ded68-60b0-4266-a3c1-a5cc1a23f781\") " pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:24.956170 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.956149    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c3ded68-60b0-4266-a3c1-a5cc1a23f781-config-file\") pod \"limitador-limitador-69574b596d-9r2d7\" (UID: \"2c3ded68-60b0-4266-a3c1-a5cc1a23f781\") " pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:24.967198 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:24.967147    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhtf\" (UniqueName: \"kubernetes.io/projected/2c3ded68-60b0-4266-a3c1-a5cc1a23f781-kube-api-access-drhtf\") pod \"limitador-limitador-69574b596d-9r2d7\" (UID: \"2c3ded68-60b0-4266-a3c1-a5cc1a23f781\") " pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:25.044845 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:25.044782    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:25.170277 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:25.170253    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-9r2d7"]
Jul 09 09:43:25.172784 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:43:25.172748    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3ded68_60b0_4266_a3c1_a5cc1a23f781.slice/crio-93f1d3ce06221545eb2bb901cf91c4474654ce69b20acbaa8cddf4a2f615bb97 WatchSource:0}: Error finding container 93f1d3ce06221545eb2bb901cf91c4474654ce69b20acbaa8cddf4a2f615bb97: Status 404 returned error can't find the container with id 93f1d3ce06221545eb2bb901cf91c4474654ce69b20acbaa8cddf4a2f615bb97
Jul 09 09:43:26.133133 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:26.133092    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7" event={"ID":"2c3ded68-60b0-4266-a3c1-a5cc1a23f781","Type":"ContainerStarted","Data":"93f1d3ce06221545eb2bb901cf91c4474654ce69b20acbaa8cddf4a2f615bb97"}
Jul 09 09:43:29.148469 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:29.148437    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7" event={"ID":"2c3ded68-60b0-4266-a3c1-a5cc1a23f781","Type":"ContainerStarted","Data":"653851e3b4bee42168336ee6eed6b2733abc5b405aab307ef0e39a2f908e877c"}
Jul 09 09:43:29.148906 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:29.148506    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:29.169630 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:29.169590    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7" podStartSLOduration=1.637091341 podStartE2EDuration="5.169577242s" totalImagesPullingTime="3.532485901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:43:29.16787218 +0000 UTC m=+587.286232015" watchObservedRunningTime="2026-07-09 09:43:29.169577242 +0000 UTC m=+587.287937074"
Jul 09 09:43:40.154163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:40.154134    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-9r2d7"
Jul 09 09:43:42.345028 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:42.344999    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:43:42.345880 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:43:42.345858    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:46:17.700373 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.700343    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"]
Jul 09 09:46:17.704461 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.704438    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.706805 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.706786    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 09:46:17.706920 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.706803    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 09:46:17.706920 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.706896    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-f9j98\""
Jul 09 09:46:17.707040 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.706927    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 09:46:17.717608 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.717583    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"]
Jul 09 09:46:17.773749 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773720    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5lx8\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-kube-api-access-x5lx8\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773749 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773751    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773786    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773805    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773825    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773879    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773902    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773915    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63a6fde-7325-4620-832f-189555743f05-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.773954 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.773937    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63a6fde-7325-4620-832f-189555743f05-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.874806 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874776    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5lx8\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-kube-api-access-x5lx8\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.874955 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874811    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.874955 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874844    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.874955 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874860    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.874955 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874875    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.874955 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874930    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875241 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874954    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875241 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.874976    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63a6fde-7325-4620-832f-189555743f05-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875241 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.875003    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63a6fde-7325-4620-832f-189555743f05-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875404 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.875307    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875404 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.875345    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875500 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.875433    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875500 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.875483    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.875690 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.875665    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63a6fde-7325-4620-832f-189555743f05-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.877293 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.877265    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.877487 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.877469    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63a6fde-7325-4620-832f-189555743f05-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.883524 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.883505    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:17.883680 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:17.883662    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5lx8\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-kube-api-access-x5lx8\") pod \"router-gateway-1-openshift-default-857cf9f944-rcfs8\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:18.014985 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.014911    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:18.171237 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.171211    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"]
Jul 09 09:46:18.172430 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:46:18.172407    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63a6fde_7325_4620_832f_189555743f05.slice/crio-ab6d68bcc9df6dd590c6250f17c5d9f5d17d081f1b47c66756beec7d1f863090 WatchSource:0}: Error finding container ab6d68bcc9df6dd590c6250f17c5d9f5d17d081f1b47c66756beec7d1f863090: Status 404 returned error can't find the container with id ab6d68bcc9df6dd590c6250f17c5d9f5d17d081f1b47c66756beec7d1f863090
Jul 09 09:46:18.174414 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.174382    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:18.174500 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.174445    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:18.174500 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.174472    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:18.940109 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.940072    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8" event={"ID":"c63a6fde-7325-4620-832f-189555743f05","Type":"ContainerStarted","Data":"c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b"}
Jul 09 09:46:18.940498 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.940126    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8" event={"ID":"c63a6fde-7325-4620-832f-189555743f05","Type":"ContainerStarted","Data":"ab6d68bcc9df6dd590c6250f17c5d9f5d17d081f1b47c66756beec7d1f863090"}
Jul 09 09:46:18.963709 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:18.963660    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8" podStartSLOduration=1.9636465269999999 podStartE2EDuration="1.963646527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:46:18.962429075 +0000 UTC m=+757.080788908" watchObservedRunningTime="2026-07-09 09:46:18.963646527 +0000 UTC m=+757.082006361"
Jul 09 09:46:19.015260 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:19.015232    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:19.020122 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:19.020099    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:19.945050 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:19.945026    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:19.945979 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:19.945962    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:23.305868 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:23.305837    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"]
Jul 09 09:46:23.306342 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:23.306011    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8" podUID="c63a6fde-7325-4620-832f-189555743f05" containerName="istio-proxy" containerID="cri-o://c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b" gracePeriod=30
Jul 09 09:46:28.548877 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.548851    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:28.671449 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671418    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-istio-token\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671609 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671474    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-socket\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671609 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671495    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63a6fde-7325-4620-832f-189555743f05-istio-podinfo\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671609 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671513    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-credential-socket\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671609 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671562    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-certs\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671609 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671602    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5lx8\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-kube-api-access-x5lx8\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671868 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671649    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-envoy\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671868 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671675    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63a6fde-7325-4620-832f-189555743f05-istiod-ca-cert\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671868 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671702    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-data\") pod \"c63a6fde-7325-4620-832f-189555743f05\" (UID: \"c63a6fde-7325-4620-832f-189555743f05\") "
Jul 09 09:46:28.671868 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671783    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:46:28.672074 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671885    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:46:28.672074 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.671999    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-data" (OuterVolumeSpecName: "istio-data") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:46:28.672250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.672097    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-data\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.672250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.672115    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-socket\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.672250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.672128    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-credential-socket\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.672250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.672166    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:46:28.672250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.672206    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63a6fde-7325-4620-832f-189555743f05-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:46:28.673706 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.673682    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-istio-token" (OuterVolumeSpecName: "istio-token") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:46:28.673825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.673734    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c63a6fde-7325-4620-832f-189555743f05-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 09:46:28.673825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.673754    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-kube-api-access-x5lx8" (OuterVolumeSpecName: "kube-api-access-x5lx8") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "kube-api-access-x5lx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:46:28.673913 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.673860    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c63a6fde-7325-4620-832f-189555743f05" (UID: "c63a6fde-7325-4620-832f-189555743f05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:46:28.773111 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.773079    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63a6fde-7325-4620-832f-189555743f05-istio-podinfo\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.773111 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.773103    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-workload-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.773111 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.773112    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5lx8\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-kube-api-access-x5lx8\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.773338 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.773123    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63a6fde-7325-4620-832f-189555743f05-istio-envoy\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.773338 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.773131    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63a6fde-7325-4620-832f-189555743f05-istiod-ca-cert\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.773338 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.773138    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63a6fde-7325-4620-832f-189555743f05-istio-token\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:46:28.987672 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.987582    2585 generic.go:356] "Generic (PLEG): container finished" podID="c63a6fde-7325-4620-832f-189555743f05" containerID="c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b" exitCode=0
Jul 09 09:46:28.987672 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.987625    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"
Jul 09 09:46:28.987844 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.987668    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8" event={"ID":"c63a6fde-7325-4620-832f-189555743f05","Type":"ContainerDied","Data":"c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b"}
Jul 09 09:46:28.987844 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.987721    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8" event={"ID":"c63a6fde-7325-4620-832f-189555743f05","Type":"ContainerDied","Data":"ab6d68bcc9df6dd590c6250f17c5d9f5d17d081f1b47c66756beec7d1f863090"}
Jul 09 09:46:28.987844 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.987747    2585 scope.go:117] "RemoveContainer" containerID="c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b"
Jul 09 09:46:28.996883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.996867    2585 scope.go:117] "RemoveContainer" containerID="c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b"
Jul 09 09:46:28.997130 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:46:28.997109    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b\": container with ID starting with c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b not found: ID does not exist" containerID="c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b"
Jul 09 09:46:28.997225 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:28.997136    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b"} err="failed to get container status \"c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b\": rpc error: code = NotFound desc = could not find container \"c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b\": container with ID starting with c277b4cfc09a5c9d6f59c77ef5e36506164ca56a1f8be3298590e8e3aa667b9b not found: ID does not exist"
Jul 09 09:46:29.010400 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:29.010378    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"]
Jul 09 09:46:29.015667 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:29.015648    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-rcfs8"]
Jul 09 09:46:30.472708 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:30.472676    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c63a6fde-7325-4620-832f-189555743f05" path="/var/lib/kubelet/pods/c63a6fde-7325-4620-832f-189555743f05/volumes"
Jul 09 09:46:34.964846 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.964814    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"]
Jul 09 09:46:34.965223 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.965215    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c63a6fde-7325-4620-832f-189555743f05" containerName="istio-proxy"
Jul 09 09:46:34.965276 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.965228    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63a6fde-7325-4620-832f-189555743f05" containerName="istio-proxy"
Jul 09 09:46:34.965315 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.965293    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c63a6fde-7325-4620-832f-189555743f05" containerName="istio-proxy"
Jul 09 09:46:34.969991 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.969975    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:34.972341 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.972323    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-f9j98\""
Jul 09 09:46:34.972422 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.972379    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 09 09:46:34.972721 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.972700    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 09 09:46:34.973169 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.973154    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 09 09:46:34.983453 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:34.983430    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"]
Jul 09 09:46:35.131470 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131435    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131470 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131467    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131683 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131488    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881d24bd-fac1-47c7-b06c-550a08717741-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131683 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131590    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131683 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131615    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881d24bd-fac1-47c7-b06c-550a08717741-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131797 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131684    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131797 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131703    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfj5p\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-kube-api-access-zfj5p\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131797 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131728    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.131797 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.131751    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.232957 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.232895    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.232957 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.232924    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfj5p\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-kube-api-access-zfj5p\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.232957 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.232945    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233218 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.232962    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233218 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233089    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233218 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233126    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233218 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233154    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881d24bd-fac1-47c7-b06c-550a08717741-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233414 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233261    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233414 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233288    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881d24bd-fac1-47c7-b06c-550a08717741-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233414 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233369    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233414 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233403    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233590 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233462    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233689 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233658    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.233825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.233807    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881d24bd-fac1-47c7-b06c-550a08717741-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.235368 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.235347    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.235662 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.235643    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881d24bd-fac1-47c7-b06c-550a08717741-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.241031 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.241005    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.241477 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.241459    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfj5p\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-kube-api-access-zfj5p\") pod \"router-gateway-1-openshift-default-857cf9f944-b8c7s\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.282487 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.282466    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:35.421755 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.421730    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"]
Jul 09 09:46:35.423840 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:46:35.423815    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881d24bd_fac1_47c7_b06c_550a08717741.slice/crio-f6bd8a2b5e9c8004a0f0a9c6bff79548a095b6cec8c976afa6b4fc72b6f9d3c6 WatchSource:0}: Error finding container f6bd8a2b5e9c8004a0f0a9c6bff79548a095b6cec8c976afa6b4fc72b6f9d3c6: Status 404 returned error can't find the container with id f6bd8a2b5e9c8004a0f0a9c6bff79548a095b6cec8c976afa6b4fc72b6f9d3c6
Jul 09 09:46:35.425858 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.425829    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:35.425939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.425893    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:35.425939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:35.425921    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:36.026730 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:36.026693    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" event={"ID":"881d24bd-fac1-47c7-b06c-550a08717741","Type":"ContainerStarted","Data":"e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e"}
Jul 09 09:46:36.027115 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:36.026776    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" event={"ID":"881d24bd-fac1-47c7-b06c-550a08717741","Type":"ContainerStarted","Data":"f6bd8a2b5e9c8004a0f0a9c6bff79548a095b6cec8c976afa6b4fc72b6f9d3c6"}
Jul 09 09:46:36.049100 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:36.049053    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" podStartSLOduration=2.049040101 podStartE2EDuration="2.049040101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:46:36.046639575 +0000 UTC m=+774.164999406" watchObservedRunningTime="2026-07-09 09:46:36.049040101 +0000 UTC m=+774.167399966"
Jul 09 09:46:36.283076 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:36.282998    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:36.287743 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:36.287718    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:37.032051 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:37.032018    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:37.033115 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:37.033094    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:47.084708 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:47.084630    2585 generic.go:356] "Generic (PLEG): container finished" podID="881d24bd-fac1-47c7-b06c-550a08717741" containerID="e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e" exitCode=0
Jul 09 09:46:47.084708 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:47.084685    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" event={"ID":"881d24bd-fac1-47c7-b06c-550a08717741","Type":"ContainerDied","Data":"e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e"}
Jul 09 09:46:47.085170 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:47.085053    2585 scope.go:117] "RemoveContainer" containerID="e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e"
Jul 09 09:46:47.086024 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:47.085990    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:47.086100 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:47.086081    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:47.086142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:47.086127    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:48.090708 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:48.090674    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" event={"ID":"881d24bd-fac1-47c7-b06c-550a08717741","Type":"ContainerStarted","Data":"dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0"}
Jul 09 09:46:48.283519 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:48.283485    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:48.284682 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:48.284645    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 09:46:49.283133 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:49.283088    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 09:46:50.283647 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:50.283599    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 09:46:51.283331 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:51.283294    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 09:46:52.032476 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:52.032439    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:52.283241 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:52.283131    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 09:46:53.544664 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:53.544626    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:53.551706 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:53.551677    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:46:54.473643 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.473617    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"]
Jul 09 09:46:54.476236 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.476214    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.478828 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.478809    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 09:46:54.479589 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.479568    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 09 09:46:54.486868 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.486847    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"]
Jul 09 09:46:54.520203 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.520166    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sg74\" (UniqueName: \"kubernetes.io/projected/0cf20d26-87b6-4b61-8738-b40399e58df8-kube-api-access-8sg74\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.520320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.520234    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.520320 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.520286    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.520393 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.520335    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cf20d26-87b6-4b61-8738-b40399e58df8-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.520393 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.520356    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.520393 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.520373    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.620909 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.620869    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sg74\" (UniqueName: \"kubernetes.io/projected/0cf20d26-87b6-4b61-8738-b40399e58df8-kube-api-access-8sg74\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.620988    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.621034    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.621109    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cf20d26-87b6-4b61-8738-b40399e58df8-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.621151    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.621211    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621630 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.621500    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621630 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.621591    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.621751 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.621624    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.623321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.623290    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.623713 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.623682    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cf20d26-87b6-4b61-8738-b40399e58df8-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.631460 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.631436    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sg74\" (UniqueName: \"kubernetes.io/projected/0cf20d26-87b6-4b61-8738-b40399e58df8-kube-api-access-8sg74\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.790367 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.790289    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:54.923899 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.923872    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"]
Jul 09 09:46:54.924552 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:46:54.924525    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf20d26_87b6_4b61_8738_b40399e58df8.slice/crio-111b50a08ea77c64ca8ba37c57609a3f31b972bd077b03e42991022c628a24ce WatchSource:0}: Error finding container 111b50a08ea77c64ca8ba37c57609a3f31b972bd077b03e42991022c628a24ce: Status 404 returned error can't find the container with id 111b50a08ea77c64ca8ba37c57609a3f31b972bd077b03e42991022c628a24ce
Jul 09 09:46:54.926532 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:54.926516    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 09:46:55.128636 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:55.128604    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222" event={"ID":"0cf20d26-87b6-4b61-8738-b40399e58df8","Type":"ContainerStarted","Data":"111b50a08ea77c64ca8ba37c57609a3f31b972bd077b03e42991022c628a24ce"}
Jul 09 09:46:56.134938 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:56.134894    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222" event={"ID":"0cf20d26-87b6-4b61-8738-b40399e58df8","Type":"ContainerStarted","Data":"d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166"}
Jul 09 09:46:56.153773 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:56.153713    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222" podStartSLOduration=1.068583146 podStartE2EDuration="2.153692436s" totalImagesPullingTime="1.08510929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:46:56.152664376 +0000 UTC m=+794.271024209" watchObservedRunningTime="2026-07-09 09:46:56.153692436 +0000 UTC m=+794.272052270"
Jul 09 09:46:56.790622 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:56.790576    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:46:57.708476 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.708450    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"]
Jul 09 09:46:57.710980 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.710960    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.727535 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.727509    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"]
Jul 09 09:46:57.750711 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.750679    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6abc49-a768-4f2e-a899-40835870939f-istio-token\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.750863 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.750722    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-workload-certs\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.750863 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.750795    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6abc49-a768-4f2e-a899-40835870939f-istio-podinfo\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.750863 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.750844    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-istio-data\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.750985 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.750907    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djssf\" (UniqueName: \"kubernetes.io/projected/0e6abc49-a768-4f2e-a899-40835870939f-kube-api-access-djssf\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.750985 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.750953    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-credential-socket\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.751055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.750984    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-istio-envoy\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.751120 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.751098    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-workload-socket\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.751155 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.751138    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6abc49-a768-4f2e-a899-40835870939f-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852608 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852573    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6abc49-a768-4f2e-a899-40835870939f-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852622    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6abc49-a768-4f2e-a899-40835870939f-istio-token\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852640    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-workload-certs\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852662    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6abc49-a768-4f2e-a899-40835870939f-istio-podinfo\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852692    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-istio-data\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852718    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djssf\" (UniqueName: \"kubernetes.io/projected/0e6abc49-a768-4f2e-a899-40835870939f-kube-api-access-djssf\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852751    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-credential-socket\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.852787 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852788    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-istio-envoy\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.853121 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.852836    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-workload-socket\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.853121 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.853069    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-workload-certs\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.853121 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.853103    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-istio-data\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.853311 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.853255    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-workload-socket\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.853311 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.853266    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-credential-socket\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.853507 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.853485    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6abc49-a768-4f2e-a899-40835870939f-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.855069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.855048    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6abc49-a768-4f2e-a899-40835870939f-istio-envoy\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.855163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.855137    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6abc49-a768-4f2e-a899-40835870939f-istio-podinfo\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.860638 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.860606    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6abc49-a768-4f2e-a899-40835870939f-istio-token\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:57.860823 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:57.860805    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djssf\" (UniqueName: \"kubernetes.io/projected/0e6abc49-a768-4f2e-a899-40835870939f-kube-api-access-djssf\") pod \"router-gateway-1-openshift-default-b49948d49-g6vgn\" (UID: \"0e6abc49-a768-4f2e-a899-40835870939f\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:58.023670 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.023567    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:46:58.146373 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.146343    2585 generic.go:356] "Generic (PLEG): container finished" podID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerID="4728876ada249d4b68e3f85ab2215bcb50804672a5649f85b5e97bb903357fa3" exitCode=0
Jul 09 09:46:58.146530 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.146419    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerDied","Data":"4728876ada249d4b68e3f85ab2215bcb50804672a5649f85b5e97bb903357fa3"}
Jul 09 09:46:58.146971 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.146957    2585 scope.go:117] "RemoveContainer" containerID="4728876ada249d4b68e3f85ab2215bcb50804672a5649f85b5e97bb903357fa3"
Jul 09 09:46:58.147814 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.147787    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:58.147925 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.147868    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:58.147993 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.147927    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:58.155589 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.155561    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"]
Jul 09 09:46:58.157813 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:46:58.157787    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6abc49_a768_4f2e_a899_40835870939f.slice/crio-5d328bfdab123ffafb0a1c30fb4ecf4a6f87efb5bb6e0a15da389567421855ff WatchSource:0}: Error finding container 5d328bfdab123ffafb0a1c30fb4ecf4a6f87efb5bb6e0a15da389567421855ff: Status 404 returned error can't find the container with id 5d328bfdab123ffafb0a1c30fb4ecf4a6f87efb5bb6e0a15da389567421855ff
Jul 09 09:46:58.159887 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.159855    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:58.159974 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.159944    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:58.160016 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:58.159981    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:46:59.154641 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.154602    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" event={"ID":"0e6abc49-a768-4f2e-a899-40835870939f","Type":"ContainerStarted","Data":"7038e3398319a5721b59c533a3de978bb8f1b37ffde4737efddf510bef9dd7b4"}
Jul 09 09:46:59.155138 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.154667    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" event={"ID":"0e6abc49-a768-4f2e-a899-40835870939f","Type":"ContainerStarted","Data":"5d328bfdab123ffafb0a1c30fb4ecf4a6f87efb5bb6e0a15da389567421855ff"}
Jul 09 09:46:59.156593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.156564    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"3d08685ee3e395edfc52f8e57c7484141c7d46ae026bf10a64f57b1c336542d2"}
Jul 09 09:46:59.202959 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.202905    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" podStartSLOduration=2.202891064 podStartE2EDuration="2.202891064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:46:59.178161804 +0000 UTC m=+797.296521637" watchObservedRunningTime="2026-07-09 09:46:59.202891064 +0000 UTC m=+797.321250895"
Jul 09 09:46:59.747728 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.747684    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:46:59.748545 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.748520    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:46:59.748761 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.748729    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:46:59.805960 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:46:59.805931    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:47:00.024507 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.024431    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:47:00.039151 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.038883    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:47:00.161530 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.161498    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:47:00.162269 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.162249    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:47:00.215583 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.215557    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"]
Jul 09 09:47:00.215772 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.215751    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy" containerID="cri-o://dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0" gracePeriod=30
Jul 09 09:47:00.748274 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.748232    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:47:00.748471 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:00.748313    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:47:01.748606 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:01.748567    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:47:01.749101 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:01.748670    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:47:02.748662 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:02.748622    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:47:02.749130 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:02.748698    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:47:03.747899 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:03.747852    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:47:03.748107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:03.747923    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:47:04.751840 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:04.751811    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:47:04.752695 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:04.752674    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:47:04.790557 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:04.790526    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:47:04.804335 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:04.804310    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:47:05.197443 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.197419    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:47:05.472284 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.472263    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:47:05.533526 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533493    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881d24bd-fac1-47c7-b06c-550a08717741-istiod-ca-cert\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533526 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533530    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-istio-token\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533766 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533574    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-envoy\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533766 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533693    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-certs\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533766 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533732    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-credential-socket\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533929 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533766    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881d24bd-fac1-47c7-b06c-550a08717741-istio-podinfo\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533929 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533815    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfj5p\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-kube-api-access-zfj5p\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533929 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533850    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-data\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.533929 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533897    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-socket\") pod \"881d24bd-fac1-47c7-b06c-550a08717741\" (UID: \"881d24bd-fac1-47c7-b06c-550a08717741\") "
Jul 09 09:47:05.534139 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533958    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:05.534139 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.533969    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/881d24bd-fac1-47c7-b06c-550a08717741-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:47:05.534321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.534267    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881d24bd-fac1-47c7-b06c-550a08717741-istiod-ca-cert\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.534321 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.534282    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.534432 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.534308    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:05.534432 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.534344    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:05.534583 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.534443    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-data" (OuterVolumeSpecName: "istio-data") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:05.536015 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.535984    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:05.536107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.536009    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-istio-token" (OuterVolumeSpecName: "istio-token") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:47:05.536107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.536088    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-kube-api-access-zfj5p" (OuterVolumeSpecName: "kube-api-access-zfj5p") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "kube-api-access-zfj5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:47:05.536250 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.536232    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/881d24bd-fac1-47c7-b06c-550a08717741-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "881d24bd-fac1-47c7-b06c-550a08717741" (UID: "881d24bd-fac1-47c7-b06c-550a08717741"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 09:47:05.635481 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.635449    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-credential-socket\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.635481 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.635474    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881d24bd-fac1-47c7-b06c-550a08717741-istio-podinfo\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.635481 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.635484    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfj5p\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-kube-api-access-zfj5p\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.635679 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.635494    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-data\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.635679 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.635502    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-workload-socket\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.635679 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.635510    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881d24bd-fac1-47c7-b06c-550a08717741-istio-token\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:05.635679 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:05.635520    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881d24bd-fac1-47c7-b06c-550a08717741-istio-envoy\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:06.193916 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.193879    2585 generic.go:356] "Generic (PLEG): container finished" podID="881d24bd-fac1-47c7-b06c-550a08717741" containerID="dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0" exitCode=0
Jul 09 09:47:06.194339 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.193926    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"
Jul 09 09:47:06.194339 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.193957    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" event={"ID":"881d24bd-fac1-47c7-b06c-550a08717741","Type":"ContainerDied","Data":"dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0"}
Jul 09 09:47:06.194339 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.194014    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s" event={"ID":"881d24bd-fac1-47c7-b06c-550a08717741","Type":"ContainerDied","Data":"f6bd8a2b5e9c8004a0f0a9c6bff79548a095b6cec8c976afa6b4fc72b6f9d3c6"}
Jul 09 09:47:06.194339 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.194046    2585 scope.go:117] "RemoveContainer" containerID="dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0"
Jul 09 09:47:06.203739 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.203723    2585 scope.go:117] "RemoveContainer" containerID="e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e"
Jul 09 09:47:06.211289 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.211268    2585 scope.go:117] "RemoveContainer" containerID="dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0"
Jul 09 09:47:06.211537 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:47:06.211519    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0\": container with ID starting with dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0 not found: ID does not exist" containerID="dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0"
Jul 09 09:47:06.211591 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.211546    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0"} err="failed to get container status \"dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0\": rpc error: code = NotFound desc = could not find container \"dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0\": container with ID starting with dd59beabc59b43471e24121046a0278882e03dfdf181e227cae099d348c4d0a0 not found: ID does not exist"
Jul 09 09:47:06.211591 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.211563    2585 scope.go:117] "RemoveContainer" containerID="e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e"
Jul 09 09:47:06.211812 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:47:06.211791    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e\": container with ID starting with e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e not found: ID does not exist" containerID="e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e"
Jul 09 09:47:06.211903 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.211816    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e"} err="failed to get container status \"e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e\": rpc error: code = NotFound desc = could not find container \"e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e\": container with ID starting with e5a4f9b94f09eaa9854e309790495422974609c5519fef1f71ed37313737345e not found: ID does not exist"
Jul 09 09:47:06.216678 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.216656    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"]
Jul 09 09:47:06.221105 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.221087    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-b8c7s"]
Jul 09 09:47:06.473375 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:06.473287    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="881d24bd-fac1-47c7-b06c-550a08717741" path="/var/lib/kubelet/pods/881d24bd-fac1-47c7-b06c-550a08717741/volumes"
Jul 09 09:47:34.102056 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:34.102027    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"]
Jul 09 09:47:49.121878 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.121833    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222" podUID="0cf20d26-87b6-4b61-8738-b40399e58df8" containerName="main" containerID="cri-o://d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166" gracePeriod=45
Jul 09 09:47:49.187425 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.187395    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222" podUID="0cf20d26-87b6-4b61-8738-b40399e58df8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.32:8000/health\": dial tcp 10.134.0.32:8000: connect: connection refused"
Jul 09 09:47:49.374874 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.374818    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:47:49.411563 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.411529    2585 generic.go:356] "Generic (PLEG): container finished" podID="0cf20d26-87b6-4b61-8738-b40399e58df8" containerID="d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166" exitCode=0
Jul 09 09:47:49.411726 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.411587    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"
Jul 09 09:47:49.411726 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.411586    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222" event={"ID":"0cf20d26-87b6-4b61-8738-b40399e58df8","Type":"ContainerDied","Data":"d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166"}
Jul 09 09:47:49.411726 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.411671    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222" event={"ID":"0cf20d26-87b6-4b61-8738-b40399e58df8","Type":"ContainerDied","Data":"111b50a08ea77c64ca8ba37c57609a3f31b972bd077b03e42991022c628a24ce"}
Jul 09 09:47:49.411726 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.411703    2585 scope.go:117] "RemoveContainer" containerID="d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166"
Jul 09 09:47:49.420209 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.420170    2585 scope.go:117] "RemoveContainer" containerID="d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166"
Jul 09 09:47:49.420477 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:47:49.420458    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166\": container with ID starting with d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166 not found: ID does not exist" containerID="d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166"
Jul 09 09:47:49.420573 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.420483    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166"} err="failed to get container status \"d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166\": rpc error: code = NotFound desc = could not find container \"d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166\": container with ID starting with d2aaeccf755b20a4fb5d0e7025c9f92732eabd2da6e117ddf54a37b18c341166 not found: ID does not exist"
Jul 09 09:47:49.535335 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535306    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-home\") pod \"0cf20d26-87b6-4b61-8738-b40399e58df8\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") "
Jul 09 09:47:49.535484 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535361    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-tmp-dir\") pod \"0cf20d26-87b6-4b61-8738-b40399e58df8\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") "
Jul 09 09:47:49.535484 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535387    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cf20d26-87b6-4b61-8738-b40399e58df8-tls-certs\") pod \"0cf20d26-87b6-4b61-8738-b40399e58df8\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") "
Jul 09 09:47:49.535484 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535419    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sg74\" (UniqueName: \"kubernetes.io/projected/0cf20d26-87b6-4b61-8738-b40399e58df8-kube-api-access-8sg74\") pod \"0cf20d26-87b6-4b61-8738-b40399e58df8\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") "
Jul 09 09:47:49.535484 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535474    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-model-cache\") pod \"0cf20d26-87b6-4b61-8738-b40399e58df8\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") "
Jul 09 09:47:49.535671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535494    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-dshm\") pod \"0cf20d26-87b6-4b61-8738-b40399e58df8\" (UID: \"0cf20d26-87b6-4b61-8738-b40399e58df8\") "
Jul 09 09:47:49.535671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535609    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-home" (OuterVolumeSpecName: "home") pod "0cf20d26-87b6-4b61-8738-b40399e58df8" (UID: "0cf20d26-87b6-4b61-8738-b40399e58df8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:49.535777 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535671    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0cf20d26-87b6-4b61-8738-b40399e58df8" (UID: "0cf20d26-87b6-4b61-8738-b40399e58df8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:49.535838 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.535787    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-model-cache" (OuterVolumeSpecName: "model-cache") pod "0cf20d26-87b6-4b61-8738-b40399e58df8" (UID: "0cf20d26-87b6-4b61-8738-b40399e58df8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:49.536035 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.536011    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:49.536152 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.536039    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:49.536152 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.536059    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:49.537585 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.537555    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf20d26-87b6-4b61-8738-b40399e58df8-kube-api-access-8sg74" (OuterVolumeSpecName: "kube-api-access-8sg74") pod "0cf20d26-87b6-4b61-8738-b40399e58df8" (UID: "0cf20d26-87b6-4b61-8738-b40399e58df8"). InnerVolumeSpecName "kube-api-access-8sg74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:47:49.537970 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.537951    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-dshm" (OuterVolumeSpecName: "dshm") pod "0cf20d26-87b6-4b61-8738-b40399e58df8" (UID: "0cf20d26-87b6-4b61-8738-b40399e58df8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:47:49.537970 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.537948    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cf20d26-87b6-4b61-8738-b40399e58df8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0cf20d26-87b6-4b61-8738-b40399e58df8" (UID: "0cf20d26-87b6-4b61-8738-b40399e58df8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:47:49.637003 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.636975    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cf20d26-87b6-4b61-8738-b40399e58df8-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:49.637003 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.637001    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cf20d26-87b6-4b61-8738-b40399e58df8-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:49.637165 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.637012    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sg74\" (UniqueName: \"kubernetes.io/projected/0cf20d26-87b6-4b61-8738-b40399e58df8-kube-api-access-8sg74\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:47:49.739780 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.739752    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"]
Jul 09 09:47:49.744268 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:49.744242    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bg6222"]
Jul 09 09:47:50.473201 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:47:50.473154    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cf20d26-87b6-4b61-8738-b40399e58df8" path="/var/lib/kubelet/pods/0cf20d26-87b6-4b61-8738-b40399e58df8/volumes"
Jul 09 09:48:37.387571 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387491    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"]
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387875    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387889    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387904    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cf20d26-87b6-4b61-8738-b40399e58df8" containerName="main"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387912    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cf20d26-87b6-4b61-8738-b40399e58df8" containerName="main"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387920    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387926    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.387998    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cf20d26-87b6-4b61-8738-b40399e58df8" containerName="main"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.388009    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy"
Jul 09 09:48:37.388055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.388016    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="881d24bd-fac1-47c7-b06c-550a08717741" containerName="istio-proxy"
Jul 09 09:48:37.391228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.391205    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.393696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.393678    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 09:48:37.394433 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.394417    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jul 09 09:48:37.403639 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.403608    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"]
Jul 09 09:48:37.465742 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.465717    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.465853 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.465751    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.465853 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.465777    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5345c508-cc46-4f57-9f4f-dcf3035efc39-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.465853 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.465799    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch8tx\" (UniqueName: \"kubernetes.io/projected/5345c508-cc46-4f57-9f4f-dcf3035efc39-kube-api-access-ch8tx\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.465963 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.465870    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.466000 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.465978    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.566975 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.566949    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.566975 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.566978    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.567224 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.567002    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5345c508-cc46-4f57-9f4f-dcf3035efc39-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.567224 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.567022    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8tx\" (UniqueName: \"kubernetes.io/projected/5345c508-cc46-4f57-9f4f-dcf3035efc39-kube-api-access-ch8tx\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.567224 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.567050    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.567224 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.567126    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.567503 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.567483    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.567573 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.567558    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.567635 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.567609    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.569343 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.569316    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.569439 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.569408    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5345c508-cc46-4f57-9f4f-dcf3035efc39-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.579644 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.579615    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch8tx\" (UniqueName: \"kubernetes.io/projected/5345c508-cc46-4f57-9f4f-dcf3035efc39-kube-api-access-ch8tx\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.727222 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.727133    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:37.888709 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:37.888684    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"]
Jul 09 09:48:37.891489 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:48:37.891461    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5345c508_cc46_4f57_9f4f_dcf3035efc39.slice/crio-791bfc93fee554313edaab83acd7f209438b7fec5a41a2fd4c5b3e1727bc37cc WatchSource:0}: Error finding container 791bfc93fee554313edaab83acd7f209438b7fec5a41a2fd4c5b3e1727bc37cc: Status 404 returned error can't find the container with id 791bfc93fee554313edaab83acd7f209438b7fec5a41a2fd4c5b3e1727bc37cc
Jul 09 09:48:38.645031 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:38.644996    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x" event={"ID":"5345c508-cc46-4f57-9f4f-dcf3035efc39","Type":"ContainerStarted","Data":"ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12"}
Jul 09 09:48:38.645439 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:38.645055    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x" event={"ID":"5345c508-cc46-4f57-9f4f-dcf3035efc39","Type":"ContainerStarted","Data":"791bfc93fee554313edaab83acd7f209438b7fec5a41a2fd4c5b3e1727bc37cc"}
Jul 09 09:48:38.678112 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:38.678060    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x" podStartSLOduration=1.678040074 podStartE2EDuration="1.678040074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:48:38.676841049 +0000 UTC m=+896.795200881" watchObservedRunningTime="2026-07-09 09:48:38.678040074 +0000 UTC m=+896.796399909"
Jul 09 09:48:38.727521 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:38.727489    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:42.375054 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:42.375028    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:48:42.376126 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:42.376104    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:48:47.728120 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:47.728083    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:47.740736 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:47.740713    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:48:48.706998 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:48:48.706971    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:49:11.332820 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:11.332787    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"]
Jul 09 09:49:26.353270 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.353207    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x" podUID="5345c508-cc46-4f57-9f4f-dcf3035efc39" containerName="main" containerID="cri-o://ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12" gracePeriod=45
Jul 09 09:49:26.607675 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.607612    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:49:26.718635 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.718604    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5345c508-cc46-4f57-9f4f-dcf3035efc39-tls-certs\") pod \"5345c508-cc46-4f57-9f4f-dcf3035efc39\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") "
Jul 09 09:49:26.718825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.718650    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch8tx\" (UniqueName: \"kubernetes.io/projected/5345c508-cc46-4f57-9f4f-dcf3035efc39-kube-api-access-ch8tx\") pod \"5345c508-cc46-4f57-9f4f-dcf3035efc39\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") "
Jul 09 09:49:26.718825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.718671    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-home\") pod \"5345c508-cc46-4f57-9f4f-dcf3035efc39\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") "
Jul 09 09:49:26.718825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.718702    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-tmp-dir\") pod \"5345c508-cc46-4f57-9f4f-dcf3035efc39\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") "
Jul 09 09:49:26.718825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.718730    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-dshm\") pod \"5345c508-cc46-4f57-9f4f-dcf3035efc39\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") "
Jul 09 09:49:26.718825 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.718766    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-model-cache\") pod \"5345c508-cc46-4f57-9f4f-dcf3035efc39\" (UID: \"5345c508-cc46-4f57-9f4f-dcf3035efc39\") "
Jul 09 09:49:26.719193 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.719002    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5345c508-cc46-4f57-9f4f-dcf3035efc39" (UID: "5345c508-cc46-4f57-9f4f-dcf3035efc39"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:49:26.719193 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.719035    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-home" (OuterVolumeSpecName: "home") pod "5345c508-cc46-4f57-9f4f-dcf3035efc39" (UID: "5345c508-cc46-4f57-9f4f-dcf3035efc39"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:49:26.719193 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.719127    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-model-cache" (OuterVolumeSpecName: "model-cache") pod "5345c508-cc46-4f57-9f4f-dcf3035efc39" (UID: "5345c508-cc46-4f57-9f4f-dcf3035efc39"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:49:26.720817 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.720787    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-dshm" (OuterVolumeSpecName: "dshm") pod "5345c508-cc46-4f57-9f4f-dcf3035efc39" (UID: "5345c508-cc46-4f57-9f4f-dcf3035efc39"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:49:26.720943 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.720876    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5345c508-cc46-4f57-9f4f-dcf3035efc39-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5345c508-cc46-4f57-9f4f-dcf3035efc39" (UID: "5345c508-cc46-4f57-9f4f-dcf3035efc39"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:49:26.720943 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.720913    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5345c508-cc46-4f57-9f4f-dcf3035efc39-kube-api-access-ch8tx" (OuterVolumeSpecName: "kube-api-access-ch8tx") pod "5345c508-cc46-4f57-9f4f-dcf3035efc39" (UID: "5345c508-cc46-4f57-9f4f-dcf3035efc39"). InnerVolumeSpecName "kube-api-access-ch8tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:49:26.820386 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.820346    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5345c508-cc46-4f57-9f4f-dcf3035efc39-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:49:26.820386 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.820381    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch8tx\" (UniqueName: \"kubernetes.io/projected/5345c508-cc46-4f57-9f4f-dcf3035efc39-kube-api-access-ch8tx\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:49:26.820386 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.820392    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:49:26.820593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.820420    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:49:26.820593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.820429    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:49:26.820593 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.820436    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5345c508-cc46-4f57-9f4f-dcf3035efc39-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:49:26.881939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.881911    2585 generic.go:356] "Generic (PLEG): container finished" podID="5345c508-cc46-4f57-9f4f-dcf3035efc39" containerID="ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12" exitCode=0
Jul 09 09:49:26.882058 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.881957    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"
Jul 09 09:49:26.882058 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.881998    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x" event={"ID":"5345c508-cc46-4f57-9f4f-dcf3035efc39","Type":"ContainerDied","Data":"ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12"}
Jul 09 09:49:26.882058 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.882056    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x" event={"ID":"5345c508-cc46-4f57-9f4f-dcf3035efc39","Type":"ContainerDied","Data":"791bfc93fee554313edaab83acd7f209438b7fec5a41a2fd4c5b3e1727bc37cc"}
Jul 09 09:49:26.882164 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.882084    2585 scope.go:117] "RemoveContainer" containerID="ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12"
Jul 09 09:49:26.891275 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.891260    2585 scope.go:117] "RemoveContainer" containerID="ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12"
Jul 09 09:49:26.891500 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:49:26.891480    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12\": container with ID starting with ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12 not found: ID does not exist" containerID="ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12"
Jul 09 09:49:26.891552 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.891509    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12"} err="failed to get container status \"ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12\": rpc error: code = NotFound desc = could not find container \"ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12\": container with ID starting with ee40614f049f54ef930b4941c8304b8282be03fdfa6af09c70fac0cd1ab44b12 not found: ID does not exist"
Jul 09 09:49:26.905120 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.905097    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"]
Jul 09 09:49:26.912363 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:26.912345    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879xtk2x"]
Jul 09 09:49:28.473093 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:28.473057    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5345c508-cc46-4f57-9f4f-dcf3035efc39" path="/var/lib/kubelet/pods/5345c508-cc46-4f57-9f4f-dcf3035efc39/volumes"
Jul 09 09:49:45.872928 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.872888    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"]
Jul 09 09:49:45.873367 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.873301    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5345c508-cc46-4f57-9f4f-dcf3035efc39" containerName="main"
Jul 09 09:49:45.873367 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.873316    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5345c508-cc46-4f57-9f4f-dcf3035efc39" containerName="main"
Jul 09 09:49:45.873462 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.873447    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5345c508-cc46-4f57-9f4f-dcf3035efc39" containerName="main"
Jul 09 09:49:45.877912 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.877873    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:45.885927 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.885906    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Jul 09 09:49:45.886053 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.885949    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 09:49:45.895107 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.895084    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"]
Jul 09 09:49:45.994476 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.994444    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:45.994476 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.994479    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:45.994709 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.994524    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:45.994709 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.994564    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:45.994709 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.994596    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:45.994709 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:45.994631    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvhq\" (UniqueName: \"kubernetes.io/projected/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-kube-api-access-rjvhq\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.095843 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.095809    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvhq\" (UniqueName: \"kubernetes.io/projected/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-kube-api-access-rjvhq\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.095843 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.095848    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.096065 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.095869    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.096065 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.095914    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.096065 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.095957    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.096065 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.095981    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.096358 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.096326    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tmp-dir\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.096475 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.096390    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-model-cache\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.096475 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.096418    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-home\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.098006 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.097985    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-dshm\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.098329 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.098310    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tls-certs\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.107887 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.107860    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvhq\" (UniqueName: \"kubernetes.io/projected/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-kube-api-access-rjvhq\") pod \"llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.188679 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.188639    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:46.330532 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.330504    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"]
Jul 09 09:49:46.332470 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:49:46.332443    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab26b0c7_04fb_479b_be8d_c8aeb98ab465.slice/crio-2b17c3a5f21a156f28cbd04130ad177dc8ffb3a2d10da690ee69b24567a836c4 WatchSource:0}: Error finding container 2b17c3a5f21a156f28cbd04130ad177dc8ffb3a2d10da690ee69b24567a836c4: Status 404 returned error can't find the container with id 2b17c3a5f21a156f28cbd04130ad177dc8ffb3a2d10da690ee69b24567a836c4
Jul 09 09:49:46.980052 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.980012    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj" event={"ID":"ab26b0c7-04fb-479b-be8d-c8aeb98ab465","Type":"ContainerStarted","Data":"cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0"}
Jul 09 09:49:46.980577 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.980079    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj" event={"ID":"ab26b0c7-04fb-479b-be8d-c8aeb98ab465","Type":"ContainerStarted","Data":"2b17c3a5f21a156f28cbd04130ad177dc8ffb3a2d10da690ee69b24567a836c4"}
Jul 09 09:49:46.999784 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:46.999709    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj" podStartSLOduration=1.99969404 podStartE2EDuration="1.99969404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:49:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:49:46.998038118 +0000 UTC m=+965.116397953" watchObservedRunningTime="2026-07-09 09:49:46.99969404 +0000 UTC m=+965.118053872"
Jul 09 09:49:47.189509 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:47.189463    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:56.188829 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:56.188786    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:56.201164 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:56.201137    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:49:57.048666 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:49:57.048634    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:52:15.857596 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:15.857558    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"]
Jul 09 09:52:30.877895 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:30.877837    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj" podUID="ab26b0c7-04fb-479b-be8d-c8aeb98ab465" containerName="main" containerID="cri-o://cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0" gracePeriod=45
Jul 09 09:52:31.034857 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.034819    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj" podUID="ab26b0c7-04fb-479b-be8d-c8aeb98ab465" containerName="main" probeResult="failure" output="Get \"https://10.134.0.35:8000/health\": dial tcp 10.134.0.35:8000: connect: connection refused"
Jul 09 09:52:31.128460 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.128402    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:52:31.254306 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254206    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-home\") pod \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") "
Jul 09 09:52:31.254490 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254349    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-model-cache\") pod \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") "
Jul 09 09:52:31.254490 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254388    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tmp-dir\") pod \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") "
Jul 09 09:52:31.254490 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254448    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-home" (OuterVolumeSpecName: "home") pod "ab26b0c7-04fb-479b-be8d-c8aeb98ab465" (UID: "ab26b0c7-04fb-479b-be8d-c8aeb98ab465"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:52:31.254490 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254471    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tls-certs\") pod \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") "
Jul 09 09:52:31.254716 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254508    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjvhq\" (UniqueName: \"kubernetes.io/projected/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-kube-api-access-rjvhq\") pod \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") "
Jul 09 09:52:31.254716 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254551    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-dshm\") pod \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\" (UID: \"ab26b0c7-04fb-479b-be8d-c8aeb98ab465\") "
Jul 09 09:52:31.254716 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254636    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab26b0c7-04fb-479b-be8d-c8aeb98ab465" (UID: "ab26b0c7-04fb-479b-be8d-c8aeb98ab465"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:52:31.254716 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254646    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab26b0c7-04fb-479b-be8d-c8aeb98ab465" (UID: "ab26b0c7-04fb-479b-be8d-c8aeb98ab465"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:52:31.254867 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254795    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:52:31.254867 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254808    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:52:31.254867 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.254816    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:52:31.256575 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.256548    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab26b0c7-04fb-479b-be8d-c8aeb98ab465" (UID: "ab26b0c7-04fb-479b-be8d-c8aeb98ab465"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:52:31.256702 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.256591    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-kube-api-access-rjvhq" (OuterVolumeSpecName: "kube-api-access-rjvhq") pod "ab26b0c7-04fb-479b-be8d-c8aeb98ab465" (UID: "ab26b0c7-04fb-479b-be8d-c8aeb98ab465"). InnerVolumeSpecName "kube-api-access-rjvhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:52:31.256702 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.256653    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-dshm" (OuterVolumeSpecName: "dshm") pod "ab26b0c7-04fb-479b-be8d-c8aeb98ab465" (UID: "ab26b0c7-04fb-479b-be8d-c8aeb98ab465"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:52:31.355971 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.355942    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjvhq\" (UniqueName: \"kubernetes.io/projected/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-kube-api-access-rjvhq\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:52:31.355971 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.355965    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:52:31.355971 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.355975    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab26b0c7-04fb-479b-be8d-c8aeb98ab465-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:52:31.769528 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.769494    2585 generic.go:356] "Generic (PLEG): container finished" podID="ab26b0c7-04fb-479b-be8d-c8aeb98ab465" containerID="cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0" exitCode=0
Jul 09 09:52:31.769729 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.769534    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"
Jul 09 09:52:31.769729 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.769579    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj" event={"ID":"ab26b0c7-04fb-479b-be8d-c8aeb98ab465","Type":"ContainerDied","Data":"cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0"}
Jul 09 09:52:31.769729 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.769636    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj" event={"ID":"ab26b0c7-04fb-479b-be8d-c8aeb98ab465","Type":"ContainerDied","Data":"2b17c3a5f21a156f28cbd04130ad177dc8ffb3a2d10da690ee69b24567a836c4"}
Jul 09 09:52:31.769729 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.769667    2585 scope.go:117] "RemoveContainer" containerID="cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0"
Jul 09 09:52:31.778497 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.778483    2585 scope.go:117] "RemoveContainer" containerID="cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0"
Jul 09 09:52:31.778730 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:52:31.778708    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0\": container with ID starting with cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0 not found: ID does not exist" containerID="cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0"
Jul 09 09:52:31.778795 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.778741    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0"} err="failed to get container status \"cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0\": rpc error: code = NotFound desc = could not find container \"cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0\": container with ID starting with cc1e33b1d7e2d0d7996ab65f185ddbfff3126d3f5e91f21c4003533a43bca4a0 not found: ID does not exist"
Jul 09 09:52:31.797128 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.797108    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"]
Jul 09 09:52:31.802752 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:31.802733    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4lxfbj"]
Jul 09 09:52:32.473369 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:32.473337    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab26b0c7-04fb-479b-be8d-c8aeb98ab465" path="/var/lib/kubelet/pods/ab26b0c7-04fb-479b-be8d-c8aeb98ab465/volumes"
Jul 09 09:52:39.693137 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.693102    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"]
Jul 09 09:52:39.693545 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.693503    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab26b0c7-04fb-479b-be8d-c8aeb98ab465" containerName="main"
Jul 09 09:52:39.693545 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.693515    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab26b0c7-04fb-479b-be8d-c8aeb98ab465" containerName="main"
Jul 09 09:52:39.693670 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.693600    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab26b0c7-04fb-479b-be8d-c8aeb98ab465" containerName="main"
Jul 09 09:52:39.697946 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.697930    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.700964 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.700944    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 09:52:39.701075 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.700967    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs\""
Jul 09 09:52:39.708331 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.708311    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"]
Jul 09 09:52:39.830975 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.830948    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.831163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.830981    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.831163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.831002    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.831163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.831079    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.831163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.831149    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4gnl\" (UniqueName: \"kubernetes.io/projected/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-kube-api-access-q4gnl\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.831350 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.831232    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932437 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932407    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932634 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932456    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4gnl\" (UniqueName: \"kubernetes.io/projected/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-kube-api-access-q4gnl\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932634 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932516    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932634 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932606    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932803 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932633    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932803 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932662    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932900 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932836    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-home\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.932900 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.932895    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-model-cache\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.933048 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.933021    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tmp-dir\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.934995 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.934974    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-dshm\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.935115 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.935097    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tls-certs\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:39.943421 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:39.943367    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4gnl\" (UniqueName: \"kubernetes.io/projected/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-kube-api-access-q4gnl\") pod \"llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:40.009559 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:40.009527    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:40.139166 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:40.139133    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"]
Jul 09 09:52:40.142493 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:52:40.142464    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d30bca3_d02e_41f4_bad4_9c3ff744e1b4.slice/crio-daf30c8c22ad13d20b0da602979b0e46f5c43099cf4667e3c29ccaf5906528ce WatchSource:0}: Error finding container daf30c8c22ad13d20b0da602979b0e46f5c43099cf4667e3c29ccaf5906528ce: Status 404 returned error can't find the container with id daf30c8c22ad13d20b0da602979b0e46f5c43099cf4667e3c29ccaf5906528ce
Jul 09 09:52:40.812925 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:40.812881    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5" event={"ID":"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4","Type":"ContainerStarted","Data":"4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3"}
Jul 09 09:52:40.813375 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:40.812952    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5" event={"ID":"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4","Type":"ContainerStarted","Data":"daf30c8c22ad13d20b0da602979b0e46f5c43099cf4667e3c29ccaf5906528ce"}
Jul 09 09:52:40.832334 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:40.832292    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5" podStartSLOduration=1.832278141 podStartE2EDuration="1.832278141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:52:40.830145835 +0000 UTC m=+1138.948505668" watchObservedRunningTime="2026-07-09 09:52:40.832278141 +0000 UTC m=+1138.950637973"
Jul 09 09:52:41.010659 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:41.010620    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:50.010064 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:50.010031    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:50.022398 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:50.022368    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:52:50.874150 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:52:50.874124    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:53:42.403939 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:53:42.403909    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:53:42.405850 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:53:42.405830    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:55:08.713294 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:08.713258    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"]
Jul 09 09:55:23.734527 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:23.734470    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5" podUID="8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" containerName="main" containerID="cri-o://4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3" gracePeriod=45
Jul 09 09:55:23.863226 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:23.863166    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5" podUID="8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.36:8000/health\": dial tcp 10.134.0.36:8000: connect: connection refused"
Jul 09 09:55:23.990838 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:23.990779    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:55:24.048441 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048410    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4gnl\" (UniqueName: \"kubernetes.io/projected/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-kube-api-access-q4gnl\") pod \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") "
Jul 09 09:55:24.048611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048451    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-home\") pod \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") "
Jul 09 09:55:24.048611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048484    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tmp-dir\") pod \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") "
Jul 09 09:55:24.048611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048521    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-dshm\") pod \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") "
Jul 09 09:55:24.048611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048572    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tls-certs\") pod \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") "
Jul 09 09:55:24.048611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048605    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-model-cache\") pod \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\" (UID: \"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4\") "
Jul 09 09:55:24.048921 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048761    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" (UID: "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:55:24.048921 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048774    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-home" (OuterVolumeSpecName: "home") pod "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" (UID: "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:55:24.049036 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.048961    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" (UID: "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:55:24.049100 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.049083    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:55:24.049235 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.049106    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:55:24.049235 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.049119    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:55:24.050572 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.050545    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-kube-api-access-q4gnl" (OuterVolumeSpecName: "kube-api-access-q4gnl") pod "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" (UID: "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4"). InnerVolumeSpecName "kube-api-access-q4gnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:55:24.050688 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.050614    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-dshm" (OuterVolumeSpecName: "dshm") pod "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" (UID: "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:55:24.050749 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.050705    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" (UID: "8d30bca3-d02e-41f4-bad4-9c3ff744e1b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:55:24.150123 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.150082    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4gnl\" (UniqueName: \"kubernetes.io/projected/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-kube-api-access-q4gnl\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:55:24.150123 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.150116    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:55:24.150123 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.150125    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:55:24.603599 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.603566    2585 generic.go:356] "Generic (PLEG): container finished" podID="8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" containerID="4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3" exitCode=0
Jul 09 09:55:24.603781 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.603611    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"
Jul 09 09:55:24.603781 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.603638    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5" event={"ID":"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4","Type":"ContainerDied","Data":"4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3"}
Jul 09 09:55:24.603781 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.603689    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5" event={"ID":"8d30bca3-d02e-41f4-bad4-9c3ff744e1b4","Type":"ContainerDied","Data":"daf30c8c22ad13d20b0da602979b0e46f5c43099cf4667e3c29ccaf5906528ce"}
Jul 09 09:55:24.603781 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.603712    2585 scope.go:117] "RemoveContainer" containerID="4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3"
Jul 09 09:55:24.612206 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.612172    2585 scope.go:117] "RemoveContainer" containerID="4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3"
Jul 09 09:55:24.612468 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:55:24.612449    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3\": container with ID starting with 4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3 not found: ID does not exist" containerID="4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3"
Jul 09 09:55:24.612528 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.612478    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3"} err="failed to get container status \"4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3\": rpc error: code = NotFound desc = could not find container \"4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3\": container with ID starting with 4cd9bec2d9c65e3271c953737cbdd1929b6515eb27498b1794e03d4a2274a5f3 not found: ID does not exist"
Jul 09 09:55:24.620696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.620672    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"]
Jul 09 09:55:24.626888 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:24.626869    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-jbwx5"]
Jul 09 09:55:26.473583 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:55:26.473542    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" path="/var/lib/kubelet/pods/8d30bca3-d02e-41f4-bad4-9c3ff744e1b4/volumes"
Jul 09 09:56:29.938957 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:29.938923    2585 generic.go:356] "Generic (PLEG): container finished" podID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerID="3d08685ee3e395edfc52f8e57c7484141c7d46ae026bf10a64f57b1c336542d2" exitCode=137
Jul 09 09:56:29.939417 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:29.938998    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerDied","Data":"3d08685ee3e395edfc52f8e57c7484141c7d46ae026bf10a64f57b1c336542d2"}
Jul 09 09:56:29.939417 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:29.939065    2585 scope.go:117] "RemoveContainer" containerID="4728876ada249d4b68e3f85ab2215bcb50804672a5649f85b5e97bb903357fa3"
Jul 09 09:56:29.939513 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:29.939473    2585 scope.go:117] "RemoveContainer" containerID="3d08685ee3e395edfc52f8e57c7484141c7d46ae026bf10a64f57b1c336542d2"
Jul 09 09:56:29.939684 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:56:29.939667    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 09:56:30.478479 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.478447    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"]
Jul 09 09:56:30.478826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.478814    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" containerName="main"
Jul 09 09:56:30.478869 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.478828    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" containerName="main"
Jul 09 09:56:30.478917 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.478908    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d30bca3-d02e-41f4-bad4-9c3ff744e1b4" containerName="main"
Jul 09 09:56:30.482700 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.482678    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.494854 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.494828    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"]
Jul 09 09:56:30.584267 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584232    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584470 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584279    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584470 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584301    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584470 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584374    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584470 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584410    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2h4w\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-kube-api-access-k2h4w\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584640 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584475    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584640 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584542    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584640 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584571    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89f49a8-0458-441f-a981-0e3aaf161e99-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.584640 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.584602    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685513 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685483    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685518    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89f49a8-0458-441f-a981-0e3aaf161e99-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685549    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685696 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685567    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685687    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685745    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685805    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.685866 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685827    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2h4w\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-kube-api-access-k2h4w\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.686077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.685878    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.686077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.686020    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-certs\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.686209 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.686102    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-data\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.686209 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.686142    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-credential-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.686318 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.686272    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-socket\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.686318 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.686295    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89f49a8-0458-441f-a981-0e3aaf161e99-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.687921 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.687901    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-envoy\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.688120 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.688101    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-podinfo\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.694133 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.694108    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-token\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.694443 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.694424    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2h4w\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-kube-api-access-k2h4w\") pod \"router-gateway-1-openshift-default-857cf9f944-wf4cz\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.793396 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.793325    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:30.931228 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.931204    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"]
Jul 09 09:56:30.933312 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:56:30.933282    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89f49a8_0458_441f_a981_0e3aaf161e99.slice/crio-988987aa899f65db21b503a6d2c423ef6207de61ffdb48e331854134e7ffddaf WatchSource:0}: Error finding container 988987aa899f65db21b503a6d2c423ef6207de61ffdb48e331854134e7ffddaf: Status 404 returned error can't find the container with id 988987aa899f65db21b503a6d2c423ef6207de61ffdb48e331854134e7ffddaf
Jul 09 09:56:30.935572 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.935538    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:30.935656 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.935605    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:30.935656 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.935633    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:30.947051 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:30.947024    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz" event={"ID":"d89f49a8-0458-441f-a981-0e3aaf161e99","Type":"ContainerStarted","Data":"988987aa899f65db21b503a6d2c423ef6207de61ffdb48e331854134e7ffddaf"}
Jul 09 09:56:31.094480 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:31.094390    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"]
Jul 09 09:56:31.953745 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:31.953714    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz" event={"ID":"d89f49a8-0458-441f-a981-0e3aaf161e99","Type":"ContainerStarted","Data":"d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980"}
Jul 09 09:56:31.974519 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:31.974458    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz" podStartSLOduration=1.9744433510000001 podStartE2EDuration="1.974443351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:56:31.97332305 +0000 UTC m=+1370.091682884" watchObservedRunningTime="2026-07-09 09:56:31.974443351 +0000 UTC m=+1370.092803182"
Jul 09 09:56:32.793861 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:32.793819    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:32.799405 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:32.799381    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:32.958601 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:32.958562    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz" podUID="d89f49a8-0458-441f-a981-0e3aaf161e99" containerName="istio-proxy" containerID="cri-o://d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980" gracePeriod=30
Jul 09 09:56:32.959207 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:32.958629    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:32.959839 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:32.959819    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:34.752442 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:34.752413    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:56:34.752826 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:34.752812    2585 scope.go:117] "RemoveContainer" containerID="3d08685ee3e395edfc52f8e57c7484141c7d46ae026bf10a64f57b1c336542d2"
Jul 09 09:56:34.753001 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:56:34.752982    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 09:56:38.212883 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.212861    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:38.253136 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253062    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2h4w\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-kube-api-access-k2h4w\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253136 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253107    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-envoy\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253379 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253136    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-certs\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253379 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253203    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89f49a8-0458-441f-a981-0e3aaf161e99-istiod-ca-cert\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253379 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253249    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-token\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253379 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253281    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-socket\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253379 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253346    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-data\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253415    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-podinfo\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253475    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-credential-socket\") pod \"d89f49a8-0458-441f-a981-0e3aaf161e99\" (UID: \"d89f49a8-0458-441f-a981-0e3aaf161e99\") "
Jul 09 09:56:38.253655 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253497    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:56:38.253817 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253756    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-data" (OuterVolumeSpecName: "istio-data") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:56:38.253877 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253836    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-data\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.253877 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.253855    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.254090 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.254045    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:56:38.254174 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.254101    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:56:38.254174 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.254156    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d89f49a8-0458-441f-a981-0e3aaf161e99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 09:56:38.255515 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.255483    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 09:56:38.255675 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.255657    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-token" (OuterVolumeSpecName: "istio-token") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:56:38.255820 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.255801    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-kube-api-access-k2h4w" (OuterVolumeSpecName: "kube-api-access-k2h4w") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "kube-api-access-k2h4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:56:38.255976 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.255960    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d89f49a8-0458-441f-a981-0e3aaf161e99" (UID: "d89f49a8-0458-441f-a981-0e3aaf161e99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:56:38.354408 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.354381    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-podinfo\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.354408 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.354403    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-credential-socket\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.354408 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.354413    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2h4w\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-kube-api-access-k2h4w\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.354614 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.354423    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-envoy\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.354614 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.354431    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d89f49a8-0458-441f-a981-0e3aaf161e99-istiod-ca-cert\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.354614 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.354438    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d89f49a8-0458-441f-a981-0e3aaf161e99-istio-token\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.354614 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.354445    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d89f49a8-0458-441f-a981-0e3aaf161e99-workload-socket\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:56:38.991931 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.991892    2585 generic.go:356] "Generic (PLEG): container finished" podID="d89f49a8-0458-441f-a981-0e3aaf161e99" containerID="d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980" exitCode=0
Jul 09 09:56:38.992103 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.991946    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"
Jul 09 09:56:38.992103 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.991952    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz" event={"ID":"d89f49a8-0458-441f-a981-0e3aaf161e99","Type":"ContainerDied","Data":"d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980"}
Jul 09 09:56:38.992103 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.992005    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz" event={"ID":"d89f49a8-0458-441f-a981-0e3aaf161e99","Type":"ContainerDied","Data":"988987aa899f65db21b503a6d2c423ef6207de61ffdb48e331854134e7ffddaf"}
Jul 09 09:56:38.992103 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:38.992037    2585 scope.go:117] "RemoveContainer" containerID="d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980"
Jul 09 09:56:39.000390 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:39.000374    2585 scope.go:117] "RemoveContainer" containerID="d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980"
Jul 09 09:56:39.000661 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:56:39.000640    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980\": container with ID starting with d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980 not found: ID does not exist" containerID="d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980"
Jul 09 09:56:39.000728 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:39.000671    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980"} err="failed to get container status \"d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980\": rpc error: code = NotFound desc = could not find container \"d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980\": container with ID starting with d7c9813055d2d456a4a97808a92ac28e3f77911dba0bf9fbad2bb7d029b81980 not found: ID does not exist"
Jul 09 09:56:39.023191 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:39.023154    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"]
Jul 09 09:56:39.030422 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:39.030393    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-857cf9f944-wf4cz"]
Jul 09 09:56:40.473131 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:40.473103    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d89f49a8-0458-441f-a981-0e3aaf161e99" path="/var/lib/kubelet/pods/d89f49a8-0458-441f-a981-0e3aaf161e99/volumes"
Jul 09 09:56:43.981800 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.981769    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"]
Jul 09 09:56:43.982210 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.982174    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89f49a8-0458-441f-a981-0e3aaf161e99" containerName="istio-proxy"
Jul 09 09:56:43.982210 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.982211    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89f49a8-0458-441f-a981-0e3aaf161e99" containerName="istio-proxy"
Jul 09 09:56:43.982296 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.982285    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d89f49a8-0458-441f-a981-0e3aaf161e99" containerName="istio-proxy"
Jul 09 09:56:43.986512 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.986488    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:43.989545 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.989522    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 09:56:43.989688 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.989559    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs\""
Jul 09 09:56:43.995998 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:43.995971    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"]
Jul 09 09:56:44.103859 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.103828    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdjg\" (UniqueName: \"kubernetes.io/projected/8c7783ef-a272-4df3-a5c5-0eea4854052a-kube-api-access-zrdjg\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.104018 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.103868    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.104018 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.103963    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.104018 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.104006    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.104128 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.104029    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.104128 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.104054    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7783ef-a272-4df3-a5c5-0eea4854052a-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.204820 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.204793    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.204837    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.204884    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.204902    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7783ef-a272-4df3-a5c5-0eea4854052a-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.204936    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdjg\" (UniqueName: \"kubernetes.io/projected/8c7783ef-a272-4df3-a5c5-0eea4854052a-kube-api-access-zrdjg\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205069 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.204980    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205603 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.205558    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205689 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.205622    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.205753 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.205683    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.207359 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.207340    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.207522 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.207507    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7783ef-a272-4df3-a5c5-0eea4854052a-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.214042 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.214007    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdjg\" (UniqueName: \"kubernetes.io/projected/8c7783ef-a272-4df3-a5c5-0eea4854052a-kube-api-access-zrdjg\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.298915 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.298855    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:44.427472 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:44.427449    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"]
Jul 09 09:56:44.429537 ip-10-0-128-170 kubenswrapper[2585]: W0709 09:56:44.429503    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7783ef_a272_4df3_a5c5_0eea4854052a.slice/crio-1d51fee9d1cf498129983902f8747092d9bfedfb16db21f7f927d4cd823205d3 WatchSource:0}: Error finding container 1d51fee9d1cf498129983902f8747092d9bfedfb16db21f7f927d4cd823205d3: Status 404 returned error can't find the container with id 1d51fee9d1cf498129983902f8747092d9bfedfb16db21f7f927d4cd823205d3
Jul 09 09:56:45.021142 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:45.021111    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k" event={"ID":"8c7783ef-a272-4df3-a5c5-0eea4854052a","Type":"ContainerStarted","Data":"9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7"}
Jul 09 09:56:45.021514 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:45.021162    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k" event={"ID":"8c7783ef-a272-4df3-a5c5-0eea4854052a","Type":"ContainerStarted","Data":"1d51fee9d1cf498129983902f8747092d9bfedfb16db21f7f927d4cd823205d3"}
Jul 09 09:56:45.041055 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:45.041002    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k" podStartSLOduration=2.040987481 podStartE2EDuration="2.040987481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 09:56:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 09:56:45.040053384 +0000 UTC m=+1383.158413231" watchObservedRunningTime="2026-07-09 09:56:45.040987481 +0000 UTC m=+1383.159347313"
Jul 09 09:56:45.299457 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:45.299384    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:49.467407 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:49.467380    2585 scope.go:117] "RemoveContainer" containerID="3d08685ee3e395edfc52f8e57c7484141c7d46ae026bf10a64f57b1c336542d2"
Jul 09 09:56:49.468534 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:49.468504    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:49.468586 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:49.468576    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:49.468654 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:49.468607    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:50.056470 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:50.056436    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934"}
Jul 09 09:56:50.747759 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:50.747722    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:56:50.749061 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:50.749029    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:56:50.749215 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:50.749090    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:56:51.748305 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:51.748266    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:56:51.748762 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:51.748332    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:56:52.749203 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:52.747804    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:56:52.749203 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:52.747900    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:56:53.748870 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:53.748394    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:56:53.748870 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:53.748464    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:56:54.299874 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:54.299831    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:54.312686 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:54.312662    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:54.748473 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:54.748431    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:56:54.748681 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:54.748500    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:56:55.081579 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.081489    2585 generic.go:356] "Generic (PLEG): container finished" podID="0e6abc49-a768-4f2e-a899-40835870939f" containerID="7038e3398319a5721b59c533a3de978bb8f1b37ffde4737efddf510bef9dd7b4" exitCode=0
Jul 09 09:56:55.081784 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.081568    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" event={"ID":"0e6abc49-a768-4f2e-a899-40835870939f","Type":"ContainerDied","Data":"7038e3398319a5721b59c533a3de978bb8f1b37ffde4737efddf510bef9dd7b4"}
Jul 09 09:56:55.082201 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.082147    2585 scope.go:117] "RemoveContainer" containerID="7038e3398319a5721b59c533a3de978bb8f1b37ffde4737efddf510bef9dd7b4"
Jul 09 09:56:55.083212 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.083171    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:55.083294 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.083259    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:55.083342 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.083291    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:56:55.093780 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.093759    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:56:55.749051 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.748612    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:56:55.749051 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:55.748677    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:56:56.092163 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:56.092060    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" event={"ID":"0e6abc49-a768-4f2e-a899-40835870939f","Type":"ContainerStarted","Data":"635aa1e2a1df0e23eb6cdd67db4b1ac493a5a9f4ba3aa16bd4a761af73b97f94"}
Jul 09 09:56:57.024336 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:57.024305    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:56:57.025674 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:57.025346    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" podUID="0e6abc49-a768-4f2e-a899-40835870939f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 09:56:57.583793 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:57.583765    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:56:57.584360 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:57.584334    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:56:57.585285 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:57.585266    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:56:58.023987 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:58.023943    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" podUID="0e6abc49-a768-4f2e-a899-40835870939f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 09:56:59.024459 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:56:59.024417    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" podUID="0e6abc49-a768-4f2e-a899-40835870939f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 09:57:00.024700 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:57:00.024658    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" podUID="0e6abc49-a768-4f2e-a899-40835870939f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 09:57:00.161991 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:57:00.161956    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:57:01.024399 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:57:01.024355    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn" podUID="0e6abc49-a768-4f2e-a899-40835870939f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 09:57:02.028432 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:57:02.028401    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:57:02.029415 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:57:02.029397    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-b49948d49-g6vgn"
Jul 09 09:58:13.705612 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:13.705580    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"]
Jul 09 09:58:28.725434 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:28.725374    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k" podUID="8c7783ef-a272-4df3-a5c5-0eea4854052a" containerName="main" containerID="cri-o://9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7" gracePeriod=45
Jul 09 09:58:28.988295 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:28.988225    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:58:29.030569 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.030534    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrdjg\" (UniqueName: \"kubernetes.io/projected/8c7783ef-a272-4df3-a5c5-0eea4854052a-kube-api-access-zrdjg\") pod \"8c7783ef-a272-4df3-a5c5-0eea4854052a\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") "
Jul 09 09:58:29.030756 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.030616    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-home\") pod \"8c7783ef-a272-4df3-a5c5-0eea4854052a\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") "
Jul 09 09:58:29.030756 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.030668    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-tmp-dir\") pod \"8c7783ef-a272-4df3-a5c5-0eea4854052a\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") "
Jul 09 09:58:29.030756 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.030697    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7783ef-a272-4df3-a5c5-0eea4854052a-tls-certs\") pod \"8c7783ef-a272-4df3-a5c5-0eea4854052a\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") "
Jul 09 09:58:29.030756 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.030729    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-dshm\") pod \"8c7783ef-a272-4df3-a5c5-0eea4854052a\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") "
Jul 09 09:58:29.030756 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.030756    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-model-cache\") pod \"8c7783ef-a272-4df3-a5c5-0eea4854052a\" (UID: \"8c7783ef-a272-4df3-a5c5-0eea4854052a\") "
Jul 09 09:58:29.031227 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.031079    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c7783ef-a272-4df3-a5c5-0eea4854052a" (UID: "8c7783ef-a272-4df3-a5c5-0eea4854052a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:58:29.031500 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.031455    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c7783ef-a272-4df3-a5c5-0eea4854052a" (UID: "8c7783ef-a272-4df3-a5c5-0eea4854052a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:58:29.031671 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.031634    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-home" (OuterVolumeSpecName: "home") pod "8c7783ef-a272-4df3-a5c5-0eea4854052a" (UID: "8c7783ef-a272-4df3-a5c5-0eea4854052a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:58:29.033573 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.033532    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7783ef-a272-4df3-a5c5-0eea4854052a-kube-api-access-zrdjg" (OuterVolumeSpecName: "kube-api-access-zrdjg") pod "8c7783ef-a272-4df3-a5c5-0eea4854052a" (UID: "8c7783ef-a272-4df3-a5c5-0eea4854052a"). InnerVolumeSpecName "kube-api-access-zrdjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 09:58:29.033784 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.033754    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-dshm" (OuterVolumeSpecName: "dshm") pod "8c7783ef-a272-4df3-a5c5-0eea4854052a" (UID: "8c7783ef-a272-4df3-a5c5-0eea4854052a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 09:58:29.034324 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.034293    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7783ef-a272-4df3-a5c5-0eea4854052a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c7783ef-a272-4df3-a5c5-0eea4854052a" (UID: "8c7783ef-a272-4df3-a5c5-0eea4854052a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 09:58:29.131680 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.131648    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrdjg\" (UniqueName: \"kubernetes.io/projected/8c7783ef-a272-4df3-a5c5-0eea4854052a-kube-api-access-zrdjg\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:58:29.131680 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.131674    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:58:29.131680 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.131684    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:58:29.131908 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.131693    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7783ef-a272-4df3-a5c5-0eea4854052a-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:58:29.131908 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.131700    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:58:29.131908 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.131708    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7783ef-a272-4df3-a5c5-0eea4854052a-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 09:58:29.569338 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.569301    2585 generic.go:356] "Generic (PLEG): container finished" podID="8c7783ef-a272-4df3-a5c5-0eea4854052a" containerID="9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7" exitCode=0
Jul 09 09:58:29.569507 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.569347    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"
Jul 09 09:58:29.569507 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.569385    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k" event={"ID":"8c7783ef-a272-4df3-a5c5-0eea4854052a","Type":"ContainerDied","Data":"9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7"}
Jul 09 09:58:29.569507 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.569447    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k" event={"ID":"8c7783ef-a272-4df3-a5c5-0eea4854052a","Type":"ContainerDied","Data":"1d51fee9d1cf498129983902f8747092d9bfedfb16db21f7f927d4cd823205d3"}
Jul 09 09:58:29.569507 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.569477    2585 scope.go:117] "RemoveContainer" containerID="9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7"
Jul 09 09:58:29.579827 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.579809    2585 scope.go:117] "RemoveContainer" containerID="9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7"
Jul 09 09:58:29.580077 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:58:29.580061    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7\": container with ID starting with 9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7 not found: ID does not exist" containerID="9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7"
Jul 09 09:58:29.580152 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.580083    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7"} err="failed to get container status \"9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7\": rpc error: code = NotFound desc = could not find container \"9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7\": container with ID starting with 9054c861db1716794f2b5b8fdc38e7fcb6fe0e81ea3b235e23688ae8bc58d0e7 not found: ID does not exist"
Jul 09 09:58:29.592312 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.592289    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"]
Jul 09 09:58:29.596550 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:29.596529    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4rg26k"]
Jul 09 09:58:30.475844 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:30.475803    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7783ef-a272-4df3-a5c5-0eea4854052a" path="/var/lib/kubelet/pods/8c7783ef-a272-4df3-a5c5-0eea4854052a/volumes"
Jul 09 09:58:42.434132 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:42.434107    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:58:42.436511 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:42.436489    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 09:58:55.710821 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:55.710791    2585 generic.go:356] "Generic (PLEG): container finished" podID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerID="641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934" exitCode=137
Jul 09 09:58:55.711357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:55.710874    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerDied","Data":"641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934"}
Jul 09 09:58:55.711357 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:55.710953    2585 scope.go:117] "RemoveContainer" containerID="3d08685ee3e395edfc52f8e57c7484141c7d46ae026bf10a64f57b1c336542d2"
Jul 09 09:58:55.711477 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:55.711360    2585 scope.go:117] "RemoveContainer" containerID="641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934"
Jul 09 09:58:55.711567 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:58:55.711549    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 09:58:57.584974 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:57.584946    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:58:57.585370 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:58:57.585355    2585 scope.go:117] "RemoveContainer" containerID="641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934"
Jul 09 09:58:57.585548 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:58:57.585530    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 09:59:12.470077 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:12.470002    2585 scope.go:117] "RemoveContainer" containerID="641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934"
Jul 09 09:59:12.470547 ip-10-0-128-170 kubenswrapper[2585]: E0709 09:59:12.470206    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 09:59:23.468095 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:23.468056    2585 scope.go:117] "RemoveContainer" containerID="641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934"
Jul 09 09:59:23.469152 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:23.469124    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:59:23.469286 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:23.469212    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:59:23.469286 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:23.469247    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 09:59:23.840400 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:23.840323    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"c75f247c0022cad06e8ebaa31ddbebcb89e44c3cbd9a9a18d0b5076faa90c79b"}
Jul 09 09:59:24.749539 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:24.749505    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:59:24.750325 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:24.750287    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:59:24.750447 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:24.750349    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:59:25.748562 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:25.748519    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:59:25.748927 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:25.748895    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:59:26.748305 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:26.748260    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:59:26.748813 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:26.748341    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:59:27.585013 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:27.584985    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:59:27.748103 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:27.748069    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:59:27.748384 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:27.748353    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:59:28.748280 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:28.748237    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 09:59:28.748595 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:28.748303    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 09:59:30.748755 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:30.748709    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 09:59:30.749151 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:30.748767    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 09:59:31.282611 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:31.282577    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 09:59:31.283748 ip-10-0-128-170 kubenswrapper[2585]: I0709 09:59:31.283725    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:03:42.465133 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:03:42.465106    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:03:42.468784 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:03:42.468762    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:08:42.499395 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:08:42.499368    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:08:42.504056 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:08:42.504036    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:13:42.528495 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:13:42.528457    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:13:42.538173 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:13:42.538148    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:18:42.559010 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:18:42.558814    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:18:42.569538 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:18:42.569520    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:22:03.282787 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:03.282742    2585 generic.go:356] "Generic (PLEG): container finished" podID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerID="c75f247c0022cad06e8ebaa31ddbebcb89e44c3cbd9a9a18d0b5076faa90c79b" exitCode=137
Jul 09 10:22:03.283268 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:03.282816    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerDied","Data":"c75f247c0022cad06e8ebaa31ddbebcb89e44c3cbd9a9a18d0b5076faa90c79b"}
Jul 09 10:22:03.283268 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:03.282887    2585 scope.go:117] "RemoveContainer" containerID="641c9eeef7052c650cac2ed6377f2a7d6f0b806d459f9fe4679ef93a949a7934"
Jul 09 10:22:03.283387 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:03.283373    2585 scope.go:117] "RemoveContainer" containerID="c75f247c0022cad06e8ebaa31ddbebcb89e44c3cbd9a9a18d0b5076faa90c79b"
Jul 09 10:22:03.284484 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:03.284455    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:22:03.284581 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:03.284524    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:22:03.284581 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:03.284561    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:22:04.290146 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:04.290108    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"9b7c73df8dd05d397ca499faa4baadb17f9c929c5649bba9c6128c26fa144475"}
Jul 09 10:22:04.748636 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:04.748601    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:22:04.749066 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:04.748982    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:22:04.749256 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:04.749233    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:22:05.747902 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:05.747853    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:22:05.748476 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:05.747928    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:22:06.748622 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:06.748583    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:22:06.749243 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:06.749212    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:22:07.748595 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:07.748560    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:22:07.748867 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:07.748838    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:22:08.747735 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:08.747693    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:22:08.748053 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:08.747765    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:22:10.560645 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:10.560607    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:22:10.561606 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:10.561580    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:22:10.562471 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:10.562453    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:22:53.550406 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:53.550375    2585 generic.go:356] "Generic (PLEG): container finished" podID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerID="9b7c73df8dd05d397ca499faa4baadb17f9c929c5649bba9c6128c26fa144475" exitCode=137
Jul 09 10:22:53.550863 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:53.550450    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerDied","Data":"9b7c73df8dd05d397ca499faa4baadb17f9c929c5649bba9c6128c26fa144475"}
Jul 09 10:22:53.550863 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:53.550517    2585 scope.go:117] "RemoveContainer" containerID="c75f247c0022cad06e8ebaa31ddbebcb89e44c3cbd9a9a18d0b5076faa90c79b"
Jul 09 10:22:53.550955 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:53.550871    2585 scope.go:117] "RemoveContainer" containerID="9b7c73df8dd05d397ca499faa4baadb17f9c929c5649bba9c6128c26fa144475"
Jul 09 10:22:53.551081 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:22:53.551058    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 10:22:55.561594 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:55.561546    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:22:55.562706 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:22:55.562683    2585 scope.go:117] "RemoveContainer" containerID="9b7c73df8dd05d397ca499faa4baadb17f9c929c5649bba9c6128c26fa144475"
Jul 09 10:22:55.562941 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:22:55.562917    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 10:23:09.468063 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:09.467977    2585 scope.go:117] "RemoveContainer" containerID="9b7c73df8dd05d397ca499faa4baadb17f9c929c5649bba9c6128c26fa144475"
Jul 09 10:23:09.469105 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:09.469073    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:23:09.469196 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:09.469159    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:23:09.469244 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:09.469227    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:23:09.636302 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:09.636269    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"8459bb41205016371538ce7a57b2beb38357bdf9c8488d2bbebfb9d0d790a5d5"}
Jul 09 10:23:09.748363 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:09.748278    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:23:10.561993 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:10.561962    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:23:10.748801 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:10.748765    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:23:10.749081 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:10.749053    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:23:11.748761 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:11.748354    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:23:11.748761 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:11.748424    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:23:12.749575 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:12.749538    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:23:12.750154 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:12.750119    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:23:13.748003 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:13.747967    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:23:13.748297 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:13.748268    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:23:14.747878 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:14.747842    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:23:14.748494 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:14.748452    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:23:15.748475 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:15.748431    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:23:15.748951 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:15.748491    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:23:17.464390 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:17.464356    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:23:17.465650 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:17.465627    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:23:42.592241 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:42.592110    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:23:42.601971 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:42.601953    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:23:56.881117 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:56.881082    2585 generic.go:356] "Generic (PLEG): container finished" podID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerID="8459bb41205016371538ce7a57b2beb38357bdf9c8488d2bbebfb9d0d790a5d5" exitCode=137
Jul 09 10:23:56.881660 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:56.881134    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerDied","Data":"8459bb41205016371538ce7a57b2beb38357bdf9c8488d2bbebfb9d0d790a5d5"}
Jul 09 10:23:56.881660 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:56.881210    2585 scope.go:117] "RemoveContainer" containerID="9b7c73df8dd05d397ca499faa4baadb17f9c929c5649bba9c6128c26fa144475"
Jul 09 10:23:56.881660 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:23:56.881648    2585 scope.go:117] "RemoveContainer" containerID="8459bb41205016371538ce7a57b2beb38357bdf9c8488d2bbebfb9d0d790a5d5"
Jul 09 10:23:56.881860 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:23:56.881838    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 10:24:02.465026 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:02.464994    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:24:02.465447 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:02.465434    2585 scope.go:117] "RemoveContainer" containerID="8459bb41205016371538ce7a57b2beb38357bdf9c8488d2bbebfb9d0d790a5d5"
Jul 09 10:24:02.465626 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:24:02.465606    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 10:24:08.862549 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.862503    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"]
Jul 09 10:24:08.863070 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.863049    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7783ef-a272-4df3-a5c5-0eea4854052a" containerName="main"
Jul 09 10:24:08.863143 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.863082    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7783ef-a272-4df3-a5c5-0eea4854052a" containerName="main"
Jul 09 10:24:08.863274 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.863242    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7783ef-a272-4df3-a5c5-0eea4854052a" containerName="main"
Jul 09 10:24:08.867168 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.867150    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.869638 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.869614    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-fd25z\""
Jul 09 10:24:08.881453 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.881427    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"]
Jul 09 10:24:08.927066 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927028    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e74b9d55-16ea-4058-9686-4df1abc858f6-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927280 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927082    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm4tv\" (UniqueName: \"kubernetes.io/projected/e74b9d55-16ea-4058-9686-4df1abc858f6-kube-api-access-cm4tv\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927280 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927148    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-token\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927280 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927227    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-envoy\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927409 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927284    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-data\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927409 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927342    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-workload-certs\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927409 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927370    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-workload-socket\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927409 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927390    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-credential-socket\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:08.927533 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:08.927448    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-podinfo\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028070 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028033    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-token\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028070 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028074    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-envoy\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028348 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028108    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-data\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028348 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028128    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-workload-certs\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028348 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028149    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-workload-socket\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028348 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028168    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-credential-socket\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028348 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028218    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-podinfo\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028348 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028251    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e74b9d55-16ea-4058-9686-4df1abc858f6-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028348 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028293    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm4tv\" (UniqueName: \"kubernetes.io/projected/e74b9d55-16ea-4058-9686-4df1abc858f6-kube-api-access-cm4tv\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028704 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028618    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-data\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028704 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028646    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-workload-certs\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028704 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028688    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-workload-socket\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.028840 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.028754    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-credential-socket\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.029121 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.029100    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e74b9d55-16ea-4058-9686-4df1abc858f6-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.030616 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.030597    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-envoy\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.030709 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.030677    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-podinfo\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.037082 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.037063    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm4tv\" (UniqueName: \"kubernetes.io/projected/e74b9d55-16ea-4058-9686-4df1abc858f6-kube-api-access-cm4tv\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.037244 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.037227    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e74b9d55-16ea-4058-9686-4df1abc858f6-istio-token\") pod \"router-gateway-2-openshift-default-578d7b9c-m7zq9\" (UID: \"e74b9d55-16ea-4058-9686-4df1abc858f6\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.176708 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.176676    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:09.317324 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.317301    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"]
Jul 09 10:24:09.319618 ip-10-0-128-170 kubenswrapper[2585]: W0709 10:24:09.319579    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74b9d55_16ea_4058_9686_4df1abc858f6.slice/crio-489476e8666971468a55663a2e4a8ea8cb25be8b26f55f469676e69b91000eb2 WatchSource:0}: Error finding container 489476e8666971468a55663a2e4a8ea8cb25be8b26f55f469676e69b91000eb2: Status 404 returned error can't find the container with id 489476e8666971468a55663a2e4a8ea8cb25be8b26f55f469676e69b91000eb2
Jul 09 10:24:09.322099 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.322059    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:09.322165 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.322134    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:09.322237 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.322164    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:09.944701 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.944665    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" event={"ID":"e74b9d55-16ea-4058-9686-4df1abc858f6","Type":"ContainerStarted","Data":"dbf7b53da7d8e559d5abe6d46b303de044e05f6b63277af86425d9fe8eecd80a"}
Jul 09 10:24:09.945090 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.944741    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" event={"ID":"e74b9d55-16ea-4058-9686-4df1abc858f6","Type":"ContainerStarted","Data":"489476e8666971468a55663a2e4a8ea8cb25be8b26f55f469676e69b91000eb2"}
Jul 09 10:24:09.968438 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:09.968384    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" podStartSLOduration=1.968368098 podStartE2EDuration="1.968368098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:24:09.966881944 +0000 UTC m=+3028.085241777" watchObservedRunningTime="2026-07-09 10:24:09.968368098 +0000 UTC m=+3028.086727930"
Jul 09 10:24:10.177445 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:10.177407    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:10.182341 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:10.182316    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:10.949538 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:10.949510    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:10.950573 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:10.950547    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:14.467897 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:14.467864    2585 scope.go:117] "RemoveContainer" containerID="8459bb41205016371538ce7a57b2beb38357bdf9c8488d2bbebfb9d0d790a5d5"
Jul 09 10:24:14.468351 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:24:14.468104    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=istio-proxy pod=openshift-ai-inference-openshift-default-655f7c58b4-962b9_openshift-ingress(82f7a1dd-03f9-4af1-9911-910e51bd241d)\"" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d"
Jul 09 10:24:23.007891 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:23.007857    2585 generic.go:356] "Generic (PLEG): container finished" podID="e74b9d55-16ea-4058-9686-4df1abc858f6" containerID="dbf7b53da7d8e559d5abe6d46b303de044e05f6b63277af86425d9fe8eecd80a" exitCode=0
Jul 09 10:24:23.008311 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:23.007913    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" event={"ID":"e74b9d55-16ea-4058-9686-4df1abc858f6","Type":"ContainerDied","Data":"dbf7b53da7d8e559d5abe6d46b303de044e05f6b63277af86425d9fe8eecd80a"}
Jul 09 10:24:23.008412 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:23.008397    2585 scope.go:117] "RemoveContainer" containerID="dbf7b53da7d8e559d5abe6d46b303de044e05f6b63277af86425d9fe8eecd80a"
Jul 09 10:24:23.009407 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:23.009381    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:23.009479 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:23.009447    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:23.009516 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:23.009481    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:24.014961 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:24.014926    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" event={"ID":"e74b9d55-16ea-4058-9686-4df1abc858f6","Type":"ContainerStarted","Data":"f92ad26b529f51fd174bd338298081230d0d95ea97efcb67e8eef39f76db0dcb"}
Jul 09 10:24:24.177250 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:24.177217    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:24.177993 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:24.177969    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" podUID="e74b9d55-16ea-4058-9686-4df1abc858f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 10:24:25.177984 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:25.177950    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" podUID="e74b9d55-16ea-4058-9686-4df1abc858f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 10:24:25.950258 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:25.950207    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:26.177259 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:26.177219    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" podUID="e74b9d55-16ea-4058-9686-4df1abc858f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 10:24:26.467665 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:26.467636    2585 scope.go:117] "RemoveContainer" containerID="8459bb41205016371538ce7a57b2beb38357bdf9c8488d2bbebfb9d0d790a5d5"
Jul 09 10:24:26.468800 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:26.468765    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:26.468902 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:26.468856    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:26.468902 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:26.468888    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 10:24:27.038815 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:27.038766    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" event={"ID":"82f7a1dd-03f9-4af1-9911-910e51bd241d","Type":"ContainerStarted","Data":"a41b41ab0b888410662e114f9bb96fe4524f1dc4248292b6875ec6dbf42efe72"}
Jul 09 10:24:27.177541 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:27.177472    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" podUID="e74b9d55-16ea-4058-9686-4df1abc858f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 10:24:27.747559 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:27.747507    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:24:27.748589 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:27.748556    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:24:27.748721 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:27.748623    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:24:28.177802 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:28.177748    2585 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9" podUID="e74b9d55-16ea-4058-9686-4df1abc858f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 10:24:28.749011 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:28.748646    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:24:28.749011 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:28.748712    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:24:29.268799 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:29.268762    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:29.270412 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:29.270391    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-578d7b9c-m7zq9"
Jul 09 10:24:29.748452 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:29.748412    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:24:29.748758 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:29.748730    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:24:30.748420 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:30.748382    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:24:30.749089 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:30.749059    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:24:31.747827 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:31.747786    2585 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-655f7c58b4-962b9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 09 10:24:31.748118 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:31.748089    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9" podUID="82f7a1dd-03f9-4af1-9911-910e51bd241d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 09 10:24:32.465464 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:32.465422    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:24:33.495289 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:33.495252    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:24:33.496691 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:24:33.496673    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-962b9"
Jul 09 10:28:42.626152 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:28:42.626125    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:28:42.635196 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:28:42.635156    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:33:42.656612 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:33:42.656583    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:33:42.664992 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:33:42.664971    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:35:15.198164 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.198135    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"]
Jul 09 10:35:15.201668 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.201653    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.205120 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.205100    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 10:35:15.205283 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.205262    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Jul 09 10:35:15.212409 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.212389    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"]
Jul 09 10:35:15.248430 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.248401    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tls-certs\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.248569 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.248470    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-dshm\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.248569 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.248504    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-home\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.248569 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.248527    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tgr8\" (UniqueName: \"kubernetes.io/projected/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-kube-api-access-2tgr8\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.248681 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.248578    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-model-cache\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.248681 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.248601    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tmp-dir\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349377 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349339    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-home\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349377 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349375    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tgr8\" (UniqueName: \"kubernetes.io/projected/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-kube-api-access-2tgr8\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349649 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349404    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-model-cache\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349649 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349427    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tmp-dir\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349649 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349465    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tls-certs\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349649 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349513    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-dshm\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349867 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349798    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-home\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349867 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349841    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tmp-dir\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.349975 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.349868    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-model-cache\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.351788 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.351765    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-dshm\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.352029 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.351999    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tls-certs\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.357884 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.357859    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tgr8\" (UniqueName: \"kubernetes.io/projected/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-kube-api-access-2tgr8\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-s8n46\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.512989 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.512910    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:15.659990 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:15.659965    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"]
Jul 09 10:35:15.662778 ip-10-0-128-170 kubenswrapper[2585]: W0709 10:35:15.662717    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b26890_dcf1_4a1c_93e1_60f7ee550b62.slice/crio-cd33e3fd7d99f4b9ed1fdd179815c4276ab9f7ab9fface55fc63be0e5490d94b WatchSource:0}: Error finding container cd33e3fd7d99f4b9ed1fdd179815c4276ab9f7ab9fface55fc63be0e5490d94b: Status 404 returned error can't find the container with id cd33e3fd7d99f4b9ed1fdd179815c4276ab9f7ab9fface55fc63be0e5490d94b
Jul 09 10:35:16.240932 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:16.240899    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46" event={"ID":"f3b26890-dcf1-4a1c-93e1-60f7ee550b62","Type":"ContainerStarted","Data":"8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b"}
Jul 09 10:35:16.241320 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:16.240948    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46" event={"ID":"f3b26890-dcf1-4a1c-93e1-60f7ee550b62","Type":"ContainerStarted","Data":"cd33e3fd7d99f4b9ed1fdd179815c4276ab9f7ab9fface55fc63be0e5490d94b"}
Jul 09 10:35:16.264726 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:16.264670    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46" podStartSLOduration=1.26465115 podStartE2EDuration="1.26465115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:35:16.262974191 +0000 UTC m=+3694.381334021" watchObservedRunningTime="2026-07-09 10:35:16.26465115 +0000 UTC m=+3694.383010982"
Jul 09 10:35:16.513963 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:16.513871    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:25.513191 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:25.513156    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:25.525703 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:25.525680    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:26.305300 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:26.305271    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:35:51.499443 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:35:51.499409    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"]
Jul 09 10:36:06.519507 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.519448    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46" podUID="f3b26890-dcf1-4a1c-93e1-60f7ee550b62" containerName="main" containerID="cri-o://8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b" gracePeriod=45
Jul 09 10:36:06.761265 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.761240    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:36:06.837658 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837581    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tls-certs\") pod \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") "
Jul 09 10:36:06.837802 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837681    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-home\") pod \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") "
Jul 09 10:36:06.837802 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837705    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-model-cache\") pod \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") "
Jul 09 10:36:06.837802 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837724    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-dshm\") pod \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") "
Jul 09 10:36:06.837802 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837746    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tgr8\" (UniqueName: \"kubernetes.io/projected/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-kube-api-access-2tgr8\") pod \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") "
Jul 09 10:36:06.838026 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837819    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tmp-dir\") pod \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\" (UID: \"f3b26890-dcf1-4a1c-93e1-60f7ee550b62\") "
Jul 09 10:36:06.838026 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837974    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-home" (OuterVolumeSpecName: "home") pod "f3b26890-dcf1-4a1c-93e1-60f7ee550b62" (UID: "f3b26890-dcf1-4a1c-93e1-60f7ee550b62"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:36:06.838026 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.837987    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3b26890-dcf1-4a1c-93e1-60f7ee550b62" (UID: "f3b26890-dcf1-4a1c-93e1-60f7ee550b62"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:36:06.838213 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.838137    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3b26890-dcf1-4a1c-93e1-60f7ee550b62" (UID: "f3b26890-dcf1-4a1c-93e1-60f7ee550b62"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:36:06.838278 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.838240    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:36:06.838278 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.838262    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:36:06.839791 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.839765    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3b26890-dcf1-4a1c-93e1-60f7ee550b62" (UID: "f3b26890-dcf1-4a1c-93e1-60f7ee550b62"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:36:06.839791 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.839779    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-kube-api-access-2tgr8" (OuterVolumeSpecName: "kube-api-access-2tgr8") pod "f3b26890-dcf1-4a1c-93e1-60f7ee550b62" (UID: "f3b26890-dcf1-4a1c-93e1-60f7ee550b62"). InnerVolumeSpecName "kube-api-access-2tgr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:36:06.839928 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.839811    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-dshm" (OuterVolumeSpecName: "dshm") pod "f3b26890-dcf1-4a1c-93e1-60f7ee550b62" (UID: "f3b26890-dcf1-4a1c-93e1-60f7ee550b62"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:36:06.939067 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.939041    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:36:06.939067 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.939065    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:36:06.939067 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.939074    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tgr8\" (UniqueName: \"kubernetes.io/projected/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-kube-api-access-2tgr8\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:36:06.939301 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:06.939083    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3b26890-dcf1-4a1c-93e1-60f7ee550b62-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:36:07.497945 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.497911    2585 generic.go:356] "Generic (PLEG): container finished" podID="f3b26890-dcf1-4a1c-93e1-60f7ee550b62" containerID="8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b" exitCode=0
Jul 09 10:36:07.498147 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.497956    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"
Jul 09 10:36:07.498147 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.498002    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46" event={"ID":"f3b26890-dcf1-4a1c-93e1-60f7ee550b62","Type":"ContainerDied","Data":"8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b"}
Jul 09 10:36:07.498147 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.498061    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46" event={"ID":"f3b26890-dcf1-4a1c-93e1-60f7ee550b62","Type":"ContainerDied","Data":"cd33e3fd7d99f4b9ed1fdd179815c4276ab9f7ab9fface55fc63be0e5490d94b"}
Jul 09 10:36:07.498147 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.498091    2585 scope.go:117] "RemoveContainer" containerID="8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b"
Jul 09 10:36:07.506854 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.506839    2585 scope.go:117] "RemoveContainer" containerID="8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b"
Jul 09 10:36:07.507089 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:36:07.507072    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b\": container with ID starting with 8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b not found: ID does not exist" containerID="8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b"
Jul 09 10:36:07.507131 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.507096    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b"} err="failed to get container status \"8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b\": rpc error: code = NotFound desc = could not find container \"8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b\": container with ID starting with 8a1aa7dedab05403a769ce0148d75ab70c93c4568077043e5813adb9090f2b7b not found: ID does not exist"
Jul 09 10:36:07.521699 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.521676    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"]
Jul 09 10:36:07.530152 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:07.530135    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-s8n46"]
Jul 09 10:36:08.473620 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:08.473581    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b26890-dcf1-4a1c-93e1-60f7ee550b62" path="/var/lib/kubelet/pods/f3b26890-dcf1-4a1c-93e1-60f7ee550b62/volumes"
Jul 09 10:36:19.996158 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:19.996129    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"]
Jul 09 10:36:19.996555 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:19.996547    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b26890-dcf1-4a1c-93e1-60f7ee550b62" containerName="main"
Jul 09 10:36:19.996615 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:19.996559    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b26890-dcf1-4a1c-93e1-60f7ee550b62" containerName="main"
Jul 09 10:36:19.996663 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:19.996642    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b26890-dcf1-4a1c-93e1-60f7ee550b62" containerName="main"
Jul 09 10:36:19.999705 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:19.999685    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.002997 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.002974    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 10:36:20.003128 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.003004    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Jul 09 10:36:20.010332 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.010310    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"]
Jul 09 10:36:20.157613 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.157574    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f276g\" (UniqueName: \"kubernetes.io/projected/42f74117-b0ee-4df8-9cd1-ed936848786b-kube-api-access-f276g\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.157786 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.157632    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.157786 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.157691    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42f74117-b0ee-4df8-9cd1-ed936848786b-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.157786 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.157746    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.157899 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.157787    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.157899 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.157805    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.258835 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.258728    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f276g\" (UniqueName: \"kubernetes.io/projected/42f74117-b0ee-4df8-9cd1-ed936848786b-kube-api-access-f276g\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.258835 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.258805    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.258835 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.258834    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42f74117-b0ee-4df8-9cd1-ed936848786b-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.259271 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.258862    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.259271 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.258902    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.259271 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.258927    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.259447 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.259326    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.259447 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.259362    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.259447 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.259409    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.261226 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.261205    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.261472 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.261454    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42f74117-b0ee-4df8-9cd1-ed936848786b-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.274087 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.274057    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f276g\" (UniqueName: \"kubernetes.io/projected/42f74117-b0ee-4df8-9cd1-ed936848786b-kube-api-access-f276g\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.310971 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.310940    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:20.460389 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.460357    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"]
Jul 09 10:36:20.462270 ip-10-0-128-170 kubenswrapper[2585]: W0709 10:36:20.462243    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f74117_b0ee_4df8_9cd1_ed936848786b.slice/crio-fcc7b76daf389dc615bc6dadfb0e2aa5a341c114fe7fe4d0f1fd6fcc37d9ae79 WatchSource:0}: Error finding container fcc7b76daf389dc615bc6dadfb0e2aa5a341c114fe7fe4d0f1fd6fcc37d9ae79: Status 404 returned error can't find the container with id fcc7b76daf389dc615bc6dadfb0e2aa5a341c114fe7fe4d0f1fd6fcc37d9ae79
Jul 09 10:36:20.563323 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.563287    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb" event={"ID":"42f74117-b0ee-4df8-9cd1-ed936848786b","Type":"ContainerStarted","Data":"6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72"}
Jul 09 10:36:20.563536 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.563359    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb" event={"ID":"42f74117-b0ee-4df8-9cd1-ed936848786b","Type":"ContainerStarted","Data":"fcc7b76daf389dc615bc6dadfb0e2aa5a341c114fe7fe4d0f1fd6fcc37d9ae79"}
Jul 09 10:36:20.584387 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:20.584330    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb" podStartSLOduration=1.584314892 podStartE2EDuration="1.584314892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:36:20.582842442 +0000 UTC m=+3758.701202283" watchObservedRunningTime="2026-07-09 10:36:20.584314892 +0000 UTC m=+3758.702674724"
Jul 09 10:36:21.311730 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:21.311695    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:30.311287 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:30.311234    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:30.323781 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:30.323756    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:30.622726 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:30.622643    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:36:54.063611 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:36:54.063572    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"]
Jul 09 10:37:09.083519 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.083480    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb" podUID="42f74117-b0ee-4df8-9cd1-ed936848786b" containerName="main" containerID="cri-o://6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72" gracePeriod=45
Jul 09 10:37:09.348368 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.348305    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:37:09.531317 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531282    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-dshm\") pod \"42f74117-b0ee-4df8-9cd1-ed936848786b\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") "
Jul 09 10:37:09.531509 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531328    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-model-cache\") pod \"42f74117-b0ee-4df8-9cd1-ed936848786b\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") "
Jul 09 10:37:09.531509 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531383    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-tmp-dir\") pod \"42f74117-b0ee-4df8-9cd1-ed936848786b\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") "
Jul 09 10:37:09.531509 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531403    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f276g\" (UniqueName: \"kubernetes.io/projected/42f74117-b0ee-4df8-9cd1-ed936848786b-kube-api-access-f276g\") pod \"42f74117-b0ee-4df8-9cd1-ed936848786b\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") "
Jul 09 10:37:09.531509 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531422    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-home\") pod \"42f74117-b0ee-4df8-9cd1-ed936848786b\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") "
Jul 09 10:37:09.531509 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531441    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42f74117-b0ee-4df8-9cd1-ed936848786b-tls-certs\") pod \"42f74117-b0ee-4df8-9cd1-ed936848786b\" (UID: \"42f74117-b0ee-4df8-9cd1-ed936848786b\") "
Jul 09 10:37:09.531787 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531720    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-home" (OuterVolumeSpecName: "home") pod "42f74117-b0ee-4df8-9cd1-ed936848786b" (UID: "42f74117-b0ee-4df8-9cd1-ed936848786b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:37:09.531787 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531742    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42f74117-b0ee-4df8-9cd1-ed936848786b" (UID: "42f74117-b0ee-4df8-9cd1-ed936848786b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:37:09.531787 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.531759    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-model-cache" (OuterVolumeSpecName: "model-cache") pod "42f74117-b0ee-4df8-9cd1-ed936848786b" (UID: "42f74117-b0ee-4df8-9cd1-ed936848786b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:37:09.533584 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.533554    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f74117-b0ee-4df8-9cd1-ed936848786b-kube-api-access-f276g" (OuterVolumeSpecName: "kube-api-access-f276g") pod "42f74117-b0ee-4df8-9cd1-ed936848786b" (UID: "42f74117-b0ee-4df8-9cd1-ed936848786b"). InnerVolumeSpecName "kube-api-access-f276g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:37:09.533713 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.533606    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f74117-b0ee-4df8-9cd1-ed936848786b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42f74117-b0ee-4df8-9cd1-ed936848786b" (UID: "42f74117-b0ee-4df8-9cd1-ed936848786b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:37:09.533713 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.533640    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-dshm" (OuterVolumeSpecName: "dshm") pod "42f74117-b0ee-4df8-9cd1-ed936848786b" (UID: "42f74117-b0ee-4df8-9cd1-ed936848786b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:37:09.632454 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.632426    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:37:09.632454 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.632452    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f276g\" (UniqueName: \"kubernetes.io/projected/42f74117-b0ee-4df8-9cd1-ed936848786b-kube-api-access-f276g\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:37:09.632637 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.632462    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:37:09.632637 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.632470    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42f74117-b0ee-4df8-9cd1-ed936848786b-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:37:09.632637 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.632478    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:37:09.632637 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.632485    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42f74117-b0ee-4df8-9cd1-ed936848786b-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:37:09.810281 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.810250    2585 generic.go:356] "Generic (PLEG): container finished" podID="42f74117-b0ee-4df8-9cd1-ed936848786b" containerID="6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72" exitCode=0
Jul 09 10:37:09.810455 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.810299    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"
Jul 09 10:37:09.810455 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.810310    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb" event={"ID":"42f74117-b0ee-4df8-9cd1-ed936848786b","Type":"ContainerDied","Data":"6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72"}
Jul 09 10:37:09.810455 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.810351    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb" event={"ID":"42f74117-b0ee-4df8-9cd1-ed936848786b","Type":"ContainerDied","Data":"fcc7b76daf389dc615bc6dadfb0e2aa5a341c114fe7fe4d0f1fd6fcc37d9ae79"}
Jul 09 10:37:09.810455 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.810373    2585 scope.go:117] "RemoveContainer" containerID="6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72"
Jul 09 10:37:09.819438 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.819421    2585 scope.go:117] "RemoveContainer" containerID="6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72"
Jul 09 10:37:09.819698 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:37:09.819679    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72\": container with ID starting with 6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72 not found: ID does not exist" containerID="6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72"
Jul 09 10:37:09.819775 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.819705    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72"} err="failed to get container status \"6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72\": rpc error: code = NotFound desc = could not find container \"6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72\": container with ID starting with 6af657a3bb8cbf496c2db84bd6ff1c0675fb64c3816720e8a73530293f408d72 not found: ID does not exist"
Jul 09 10:37:09.832174 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.832149    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"]
Jul 09 10:37:09.837749 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:09.837728    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvkpb"]
Jul 09 10:37:10.473149 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:37:10.473109    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f74117-b0ee-4df8-9cd1-ed936848786b" path="/var/lib/kubelet/pods/42f74117-b0ee-4df8-9cd1-ed936848786b/volumes"
Jul 09 10:38:12.784578 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.784545    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"]
Jul 09 10:38:12.785022 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.784930    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f74117-b0ee-4df8-9cd1-ed936848786b" containerName="main"
Jul 09 10:38:12.785022 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.784941    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f74117-b0ee-4df8-9cd1-ed936848786b" containerName="main"
Jul 09 10:38:12.785022 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.785000    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="42f74117-b0ee-4df8-9cd1-ed936848786b" containerName="main"
Jul 09 10:38:12.788092 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.788075    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:12.791651 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.791631    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 10:38:12.791731 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.791710    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-custom-template-test-kserve-self-signed-certs\""
Jul 09 10:38:12.799977 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.799955    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"]
Jul 09 10:38:12.916012 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.915980    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbaf509-1721-4546-92ad-4a0aafa539b0-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:12.916012 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.916014    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:12.916339 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.916124    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcnqz\" (UniqueName: \"kubernetes.io/projected/cbbaf509-1721-4546-92ad-4a0aafa539b0-kube-api-access-dcnqz\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:12.916339 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.916217    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:12.916339 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.916251    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:12.916339 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:12.916288    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017040 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017008    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbaf509-1721-4546-92ad-4a0aafa539b0-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017040 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017333 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017100    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcnqz\" (UniqueName: \"kubernetes.io/projected/cbbaf509-1721-4546-92ad-4a0aafa539b0-kube-api-access-dcnqz\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017333 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017127    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017333 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017142    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017481 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017363    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017698 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017672    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-home\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017776 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017680    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-tmp-dir\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.017776 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.017733    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-model-cache\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.019498 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.019477    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-dshm\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.019620 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.019601    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbaf509-1721-4546-92ad-4a0aafa539b0-tls-certs\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.026369 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.026350    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcnqz\" (UniqueName: \"kubernetes.io/projected/cbbaf509-1721-4546-92ad-4a0aafa539b0-kube-api-access-dcnqz\") pod \"scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") " pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.098010 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.097931    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:13.237748 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:13.237721    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"]
Jul 09 10:38:13.239746 ip-10-0-128-170 kubenswrapper[2585]: W0709 10:38:13.239722    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbaf509_1721_4546_92ad_4a0aafa539b0.slice/crio-83847e00b8dfd887167decd94a1c7788d02a21654594ff8b9b1f922aa9237d27 WatchSource:0}: Error finding container 83847e00b8dfd887167decd94a1c7788d02a21654594ff8b9b1f922aa9237d27: Status 404 returned error can't find the container with id 83847e00b8dfd887167decd94a1c7788d02a21654594ff8b9b1f922aa9237d27
Jul 09 10:38:14.117130 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:14.117095    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl" event={"ID":"cbbaf509-1721-4546-92ad-4a0aafa539b0","Type":"ContainerStarted","Data":"cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606"}
Jul 09 10:38:14.117688 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:14.117144    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl" event={"ID":"cbbaf509-1721-4546-92ad-4a0aafa539b0","Type":"ContainerStarted","Data":"83847e00b8dfd887167decd94a1c7788d02a21654594ff8b9b1f922aa9237d27"}
Jul 09 10:38:14.140173 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:14.140116    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl" podStartSLOduration=2.14010094 podStartE2EDuration="2.14010094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:38:14.137642647 +0000 UTC m=+3872.256002476" watchObservedRunningTime="2026-07-09 10:38:14.14010094 +0000 UTC m=+3872.258460772"
Jul 09 10:38:15.098415 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:15.098382    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:23.098543 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:23.098510    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:23.110995 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:23.110973    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:23.178163 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:23.178133    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:38:42.688321 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:42.688293    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:38:42.695910 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:42.695886    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:38:46.901020 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:38:46.900987    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"]
Jul 09 10:39:01.921128 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:01.921065    2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl" podUID="cbbaf509-1721-4546-92ad-4a0aafa539b0" containerName="main" containerID="cri-o://cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606" gracePeriod=45
Jul 09 10:39:02.180657 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.180597    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:39:02.286713 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.286685    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-home\") pod \"cbbaf509-1721-4546-92ad-4a0aafa539b0\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") "
Jul 09 10:39:02.286898 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.286785    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-tmp-dir\") pod \"cbbaf509-1721-4546-92ad-4a0aafa539b0\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") "
Jul 09 10:39:02.286898 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.286818    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-model-cache\") pod \"cbbaf509-1721-4546-92ad-4a0aafa539b0\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") "
Jul 09 10:39:02.286898 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.286853    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-dshm\") pod \"cbbaf509-1721-4546-92ad-4a0aafa539b0\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") "
Jul 09 10:39:02.286898 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.286877    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcnqz\" (UniqueName: \"kubernetes.io/projected/cbbaf509-1721-4546-92ad-4a0aafa539b0-kube-api-access-dcnqz\") pod \"cbbaf509-1721-4546-92ad-4a0aafa539b0\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") "
Jul 09 10:39:02.287125 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.286907    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbaf509-1721-4546-92ad-4a0aafa539b0-tls-certs\") pod \"cbbaf509-1721-4546-92ad-4a0aafa539b0\" (UID: \"cbbaf509-1721-4546-92ad-4a0aafa539b0\") "
Jul 09 10:39:02.287125 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.286928    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-home" (OuterVolumeSpecName: "home") pod "cbbaf509-1721-4546-92ad-4a0aafa539b0" (UID: "cbbaf509-1721-4546-92ad-4a0aafa539b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:39:02.287125 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.287085    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbbaf509-1721-4546-92ad-4a0aafa539b0" (UID: "cbbaf509-1721-4546-92ad-4a0aafa539b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:39:02.287125 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.287097    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbbaf509-1721-4546-92ad-4a0aafa539b0" (UID: "cbbaf509-1721-4546-92ad-4a0aafa539b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:39:02.287322 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.287134    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-home\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:39:02.288934 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.288899    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-dshm" (OuterVolumeSpecName: "dshm") pod "cbbaf509-1721-4546-92ad-4a0aafa539b0" (UID: "cbbaf509-1721-4546-92ad-4a0aafa539b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 10:39:02.289052 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.288967    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbbaf509-1721-4546-92ad-4a0aafa539b0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbbaf509-1721-4546-92ad-4a0aafa539b0" (UID: "cbbaf509-1721-4546-92ad-4a0aafa539b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 10:39:02.289052 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.288994    2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbaf509-1721-4546-92ad-4a0aafa539b0-kube-api-access-dcnqz" (OuterVolumeSpecName: "kube-api-access-dcnqz") pod "cbbaf509-1721-4546-92ad-4a0aafa539b0" (UID: "cbbaf509-1721-4546-92ad-4a0aafa539b0"). InnerVolumeSpecName "kube-api-access-dcnqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 10:39:02.362436 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.362398    2585 generic.go:356] "Generic (PLEG): container finished" podID="cbbaf509-1721-4546-92ad-4a0aafa539b0" containerID="cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606" exitCode=0
Jul 09 10:39:02.362593 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.362446    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"
Jul 09 10:39:02.362593 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.362480    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl" event={"ID":"cbbaf509-1721-4546-92ad-4a0aafa539b0","Type":"ContainerDied","Data":"cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606"}
Jul 09 10:39:02.362593 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.362538    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl" event={"ID":"cbbaf509-1721-4546-92ad-4a0aafa539b0","Type":"ContainerDied","Data":"83847e00b8dfd887167decd94a1c7788d02a21654594ff8b9b1f922aa9237d27"}
Jul 09 10:39:02.362593 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.362553    2585 scope.go:117] "RemoveContainer" containerID="cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606"
Jul 09 10:39:02.375355 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.375337    2585 scope.go:117] "RemoveContainer" containerID="cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606"
Jul 09 10:39:02.375626 ip-10-0-128-170 kubenswrapper[2585]: E0709 10:39:02.375609    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606\": container with ID starting with cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606 not found: ID does not exist" containerID="cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606"
Jul 09 10:39:02.375706 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.375632    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606"} err="failed to get container status \"cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606\": rpc error: code = NotFound desc = could not find container \"cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606\": container with ID starting with cc0a38aacce81cf91401e34794ea37dd7e8ef98975b52c73796bbefcd8797606 not found: ID does not exist"
Jul 09 10:39:02.388273 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.388254    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-dshm\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:39:02.388379 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.388276    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcnqz\" (UniqueName: \"kubernetes.io/projected/cbbaf509-1721-4546-92ad-4a0aafa539b0-kube-api-access-dcnqz\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:39:02.388379 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.388285    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbaf509-1721-4546-92ad-4a0aafa539b0-tls-certs\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:39:02.388379 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.388314    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-tmp-dir\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:39:02.388379 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.388323    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbaf509-1721-4546-92ad-4a0aafa539b0-model-cache\") on node \"ip-10-0-128-170.ec2.internal\" DevicePath \"\""
Jul 09 10:39:02.392125 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.392108    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"]
Jul 09 10:39:02.398678 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.398661    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl"]
Jul 09 10:39:02.472801 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:02.472727    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbaf509-1721-4546-92ad-4a0aafa539b0" path="/var/lib/kubelet/pods/cbbaf509-1721-4546-92ad-4a0aafa539b0/volumes"
Jul 09 10:39:03.167941 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:03.167899    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-v5zvl" podUID="cbbaf509-1721-4546-92ad-4a0aafa539b0" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 09 10:39:30.159861 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.159827    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"]
Jul 09 10:39:30.160471 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.160418    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbaf509-1721-4546-92ad-4a0aafa539b0" containerName="main"
Jul 09 10:39:30.160471 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.160437    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbaf509-1721-4546-92ad-4a0aafa539b0" containerName="main"
Jul 09 10:39:30.160589 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.160566    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbaf509-1721-4546-92ad-4a0aafa539b0" containerName="main"
Jul 09 10:39:30.163490 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.163470    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.166825 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.166797    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 09 10:39:30.166923 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.166861    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkhz8\""
Jul 09 10:39:30.179972 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.179948    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"]
Jul 09 10:39:30.243447 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.243412    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.243613 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.243458    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.243613 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.243520    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.243613 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.243578    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97122a24-a7d1-41b4-81e7-d16c92891c22-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.243613 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.243601    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lw8k\" (UniqueName: \"kubernetes.io/projected/97122a24-a7d1-41b4-81e7-d16c92891c22-kube-api-access-2lw8k\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.243776 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.243629    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344371 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344337    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344555 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344387    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344555 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344424    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344555 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344481    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97122a24-a7d1-41b4-81e7-d16c92891c22-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344555 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344514    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lw8k\" (UniqueName: \"kubernetes.io/projected/97122a24-a7d1-41b4-81e7-d16c92891c22-kube-api-access-2lw8k\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344555 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344543    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344826 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344802    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344890 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344810    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.344890 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.344860    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.346873 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.346848    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97122a24-a7d1-41b4-81e7-d16c92891c22-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.346991 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.346976    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97122a24-a7d1-41b4-81e7-d16c92891c22-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.353001 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.352978    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lw8k\" (UniqueName: \"kubernetes.io/projected/97122a24-a7d1-41b4-81e7-d16c92891c22-kube-api-access-2lw8k\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn\" (UID: \"97122a24-a7d1-41b4-81e7-d16c92891c22\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.473796 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.473707    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:30.620229 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:30.620201    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"]
Jul 09 10:39:30.621094 ip-10-0-128-170 kubenswrapper[2585]: W0709 10:39:30.621073    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97122a24_a7d1_41b4_81e7_d16c92891c22.slice/crio-1b74bfd25f614ee32ecfc6c468717432ee6cc47e338f77c7ad0101b759bae97c WatchSource:0}: Error finding container 1b74bfd25f614ee32ecfc6c468717432ee6cc47e338f77c7ad0101b759bae97c: Status 404 returned error can't find the container with id 1b74bfd25f614ee32ecfc6c468717432ee6cc47e338f77c7ad0101b759bae97c
Jul 09 10:39:31.506878 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:31.506840    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn" event={"ID":"97122a24-a7d1-41b4-81e7-d16c92891c22","Type":"ContainerStarted","Data":"708ea63bdaf929c7590265ca003caa01463f3b2eea86833dccf31497c0337de2"}
Jul 09 10:39:31.507307 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:31.506900    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn" event={"ID":"97122a24-a7d1-41b4-81e7-d16c92891c22","Type":"ContainerStarted","Data":"1b74bfd25f614ee32ecfc6c468717432ee6cc47e338f77c7ad0101b759bae97c"}
Jul 09 10:39:31.528335 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:31.528286    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn" podStartSLOduration=1.528268961 podStartE2EDuration="1.528268961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 10:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:39:31.527852399 +0000 UTC m=+3949.646212231" watchObservedRunningTime="2026-07-09 10:39:31.528268961 +0000 UTC m=+3949.646628794"
Jul 09 10:39:32.474646 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:32.474608    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:40.474614 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:40.474581    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:40.487085 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:40.487060    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:39:40.561899 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:39:40.561873    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn"
Jul 09 10:43:42.720045 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:43:42.720015    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:43:42.729315 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:43:42.729294    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:48:42.755372 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:48:42.755297    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:48:42.764641 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:48:42.764615    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:53:42.787759 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:53:42.787660    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:53:42.796721 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:53:42.796703    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:58:32.618647 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:32.618614    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:58:42.819483 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:42.819364    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:58:42.828564 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:42.828545    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4jtwj_c3fff5db-218c-40db-b781-06820aaee71c/ovn-acl-logging/0.log"
Jul 09 10:58:51.653025 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:51.652992    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:58:51.654797 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:51.654769    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:58:51.669028 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:51.669005    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:58:51.669456 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:51.669439    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:58:51.715157 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:51.715138    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:58:53.203065 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:53.203037    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:58:53.204886 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:53.204858    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:58:53.219822 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:53.219798    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:58:53.220270 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:53.220244    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:58:53.263701 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:53.263679    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:58:54.736127 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:54.736094    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:58:54.737657 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:54.737633    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:58:54.752854 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:54.752836    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:58:54.753228 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:54.753209    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:58:54.794326 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:54.794305    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:58:56.272419 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:56.272390    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:58:56.274258 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:56.274236    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:58:56.290424 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:56.290405    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:58:56.290837 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:56.290818    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:58:56.329817 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:56.329789    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:58:57.838153 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:57.838115    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:58:57.839769 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:57.839747    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:58:57.852818 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:57.852795    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:58:57.853090 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:57.853068    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:58:57.890515 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:57.890471    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:58:59.356097 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:59.356065    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:58:59.357687 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:59.357666    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:58:59.371416 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:59.371391    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:58:59.371873 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:59.371851    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:58:59.412475 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:58:59.412452    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:00.880099 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:00.880063    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:00.881666 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:00.881631    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:00.894833 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:00.894809    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:00.895321 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:00.895299    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:00.939694 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:00.939672    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:02.443976 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:02.443932    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:02.445771 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:02.445749    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:02.459388 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:02.459363    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:02.459854 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:02.459828    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:02.502478 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:02.502457    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:04.055105 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:04.055019    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:04.056768 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:04.056739    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:04.072916 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:04.072889    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:04.073340 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:04.073317    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:04.117563 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:04.117543    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:05.677413 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:05.677381    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:05.678753 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:05.678729    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:05.693296 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:05.693270    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:05.693699 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:05.693663    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:05.754890 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:05.754866    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:07.242539 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:07.242514    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:07.243998 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:07.243973    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:07.259008 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:07.258982    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:07.259337 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:07.259318    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:07.297716 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:07.297696    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:08.779221 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:08.779190    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:08.781007 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:08.780969    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:08.794274 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:08.794252    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:08.794747 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:08.794724    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:08.837462 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:08.837420    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:10.297465 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:10.297430    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:10.298930 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:10.298907    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:10.311603 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:10.311580    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:10.312026 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:10.312013    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:10.355541 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:10.355514    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:11.862189 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:11.862139    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:11.863770 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:11.863749    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:11.878554 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:11.878519    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:11.879136 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:11.879117    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:11.918302 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:11.918278    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:13.363596 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:13.363567    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:13.365202 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:13.365162    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:13.378585 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:13.378555    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:13.379022 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:13.379004    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:13.420780 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:13.420756    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:14.866309 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:14.866280    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/0.log"
Jul 09 10:59:14.867884 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:14.867862    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-b49948d49-g6vgn_0e6abc49-a768-4f2e-a899-40835870939f/istio-proxy/1.log"
Jul 09 10:59:14.880415 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:14.880392    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/1.log"
Jul 09 10:59:14.880851 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:14.880826    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-578d7b9c-m7zq9_e74b9d55-16ea-4058-9686-4df1abc858f6/istio-proxy/0.log"
Jul 09 10:59:14.921911 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:14.921891    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-vghgn_97122a24-a7d1-41b4-81e7-d16c92891c22/main/0.log"
Jul 09 10:59:16.767688 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:16.767635    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/5.log"
Jul 09 10:59:16.780475 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:16.780443    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/6.log"
Jul 09 10:59:18.102925 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:18.102892    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/5.log"
Jul 09 10:59:18.115978 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:18.115951    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/6.log"
Jul 09 10:59:19.451583 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:19.451548    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/5.log"
Jul 09 10:59:19.464686 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:19.464659    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/6.log"
Jul 09 10:59:20.740732 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:20.740704    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/5.log"
Jul 09 10:59:20.754366 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:20.754343    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/6.log"
Jul 09 10:59:21.711987 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:21.711959    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:21.904693 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:21.904663    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:22.960102 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:22.960070    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:23.150665 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:23.150625    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:24.192520 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:24.192487    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:24.370712 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:24.370684    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:25.388835 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:25.388802    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:25.572272 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:25.572232    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:26.596849 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:26.596809    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:26.785559 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:26.785529    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:27.829481 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:27.829455    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:28.010443 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:28.010416    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:29.048066 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:29.048029    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:29.232382 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:29.232353    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:30.274776 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:30.274750    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:30.470526 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:30.470496    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:31.526143 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:31.526117    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:31.711095 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:31.711063    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:32.739665 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:32.739635    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:32.918305 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:32.918275    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:33.948293 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:33.948267    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:34.132278 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:34.132249    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:39.563919 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:39.563889    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-skqw5_6b2f1a17-546c-4814-be44-ae594f9a1752/global-pull-secret-syncer/0.log"
Jul 09 10:59:39.702587 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:39.702553    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h2n7j_cd6084d8-d2de-482b-acdf-695e4c610731/konnectivity-agent/0.log"
Jul 09 10:59:39.776868 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:39.776843    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-170.ec2.internal_8937e12f98485ce07bb67269f2903696/haproxy/0.log"
Jul 09 10:59:45.004965 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:45.004933    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-xhvv8_05a35e02-ff9a-4b44-8659-7278ee43818f/manager/0.log"
Jul 09 10:59:45.287124 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:45.287055    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-9r2d7_2c3ded68-60b0-4266-a3c1-a5cc1a23f781/limitador/0.log"
Jul 09 10:59:46.444691 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.444659    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e570b3a3-75b2-4b35-8f3f-55a55e6cd419/alertmanager/0.log"
Jul 09 10:59:46.471515 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.471490    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e570b3a3-75b2-4b35-8f3f-55a55e6cd419/config-reloader/0.log"
Jul 09 10:59:46.497951 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.497927    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e570b3a3-75b2-4b35-8f3f-55a55e6cd419/kube-rbac-proxy-web/0.log"
Jul 09 10:59:46.520151 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.520131    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e570b3a3-75b2-4b35-8f3f-55a55e6cd419/kube-rbac-proxy/0.log"
Jul 09 10:59:46.542446 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.542421    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e570b3a3-75b2-4b35-8f3f-55a55e6cd419/kube-rbac-proxy-metric/0.log"
Jul 09 10:59:46.570427 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.570404    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e570b3a3-75b2-4b35-8f3f-55a55e6cd419/prom-label-proxy/0.log"
Jul 09 10:59:46.594374 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.594356    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e570b3a3-75b2-4b35-8f3f-55a55e6cd419/init-config-reloader/0.log"
Jul 09 10:59:46.687102 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.687080    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k6gsf_4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff/kube-state-metrics/0.log"
Jul 09 10:59:46.703537 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.703473    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k6gsf_4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff/kube-rbac-proxy-main/0.log"
Jul 09 10:59:46.730582 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.730565    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k6gsf_4f5f8d0e-1e21-4a53-bb9f-fc17a199d8ff/kube-rbac-proxy-self/0.log"
Jul 09 10:59:46.758455 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.758427    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66f4b65746-xzst4_29975419-87a3-4d24-aba4-865a710348d4/metrics-server/0.log"
Jul 09 10:59:46.787690 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.787668    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-d6qmx_267e6d1b-4bcc-4bc1-b7a1-0ef34ed7ffd6/monitoring-plugin/0.log"
Jul 09 10:59:46.961766 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:46.961683    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9bfl_d2d1303b-e086-47e6-924c-f7604015d2ab/node-exporter/0.log"
Jul 09 10:59:47.092717 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.092692    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9bfl_d2d1303b-e086-47e6-924c-f7604015d2ab/kube-rbac-proxy/0.log"
Jul 09 10:59:47.146158 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.146140    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9bfl_d2d1303b-e086-47e6-924c-f7604015d2ab/init-textfile/0.log"
Jul 09 10:59:47.298242 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.298141    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4dvqp_d4d89380-65e6-4a2c-a3fd-628df610f43e/kube-rbac-proxy-main/0.log"
Jul 09 10:59:47.322766 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.322741    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4dvqp_d4d89380-65e6-4a2c-a3fd-628df610f43e/kube-rbac-proxy-self/0.log"
Jul 09 10:59:47.348802 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.348784    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4dvqp_d4d89380-65e6-4a2c-a3fd-628df610f43e/openshift-state-metrics/0.log"
Jul 09 10:59:47.402802 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.402781    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6dce7fa1-1246-4f9a-a4c0-425f2de41a75/prometheus/0.log"
Jul 09 10:59:47.428017 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.427994    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6dce7fa1-1246-4f9a-a4c0-425f2de41a75/config-reloader/0.log"
Jul 09 10:59:47.454051 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.454029    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6dce7fa1-1246-4f9a-a4c0-425f2de41a75/thanos-sidecar/0.log"
Jul 09 10:59:47.485869 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.485848    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6dce7fa1-1246-4f9a-a4c0-425f2de41a75/kube-rbac-proxy-web/0.log"
Jul 09 10:59:47.517606 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.517575    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6dce7fa1-1246-4f9a-a4c0-425f2de41a75/kube-rbac-proxy/0.log"
Jul 09 10:59:47.552746 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.552668    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6dce7fa1-1246-4f9a-a4c0-425f2de41a75/kube-rbac-proxy-thanos/0.log"
Jul 09 10:59:47.576031 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.576005    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6dce7fa1-1246-4f9a-a4c0-425f2de41a75/init-config-reloader/0.log"
Jul 09 10:59:47.612735 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.612709    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9vh9l_e25c210e-0a03-4695-981e-831e4f004bfc/prometheus-operator/0.log"
Jul 09 10:59:47.632895 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.632870    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9vh9l_e25c210e-0a03-4695-981e-831e4f004bfc/kube-rbac-proxy/0.log"
Jul 09 10:59:47.660360 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.660340    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6xrpk_75b703dc-9bec-4df0-97cc-1d692388046b/prometheus-operator-admission-webhook/0.log"
Jul 09 10:59:47.793908 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.793876    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/thanos-query/0.log"
Jul 09 10:59:47.816672 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.816605    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy-web/0.log"
Jul 09 10:59:47.842425 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.842398    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy/0.log"
Jul 09 10:59:47.866191 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.866154    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/prom-label-proxy/0.log"
Jul 09 10:59:47.896202 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.896155    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy-rules/0.log"
Jul 09 10:59:47.919916 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:47.919895    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dd8f7bcf-p8vw4_afb3978f-5084-4a40-b10f-7f2441c29b9d/kube-rbac-proxy-metrics/0.log"
Jul 09 10:59:49.514168 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.514137    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"]
Jul 09 10:59:49.517593 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.517568    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.519871 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.519849    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8w7l\"/\"openshift-service-ca.crt\""
Jul 09 10:59:49.520048 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.520033    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d8w7l\"/\"default-dockercfg-zlpx4\""
Jul 09 10:59:49.520600 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.520584    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8w7l\"/\"kube-root-ca.crt\""
Jul 09 10:59:49.530066 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.530048    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"]
Jul 09 10:59:49.548974 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.548947    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-lib-modules\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.549129 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.548991    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-podres\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.549129 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.549116    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2tzk\" (UniqueName: \"kubernetes.io/projected/8474167c-2f36-4d10-8964-54a4941aff06-kube-api-access-w2tzk\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.549271 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.549173    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-proc\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.549369 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.549352    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-sys\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.650814 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650782    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-lib-modules\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.650814 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650815    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-podres\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.651021 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650840    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tzk\" (UniqueName: \"kubernetes.io/projected/8474167c-2f36-4d10-8964-54a4941aff06-kube-api-access-w2tzk\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.651021 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650871    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-proc\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.651021 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650910    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-sys\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.651021 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650946    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-lib-modules\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.651021 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650998    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-proc\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.651021 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.650947    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-podres\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.651021 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.651008    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8474167c-2f36-4d10-8964-54a4941aff06-sys\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.659254 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.659234    2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2tzk\" (UniqueName: \"kubernetes.io/projected/8474167c-2f36-4d10-8964-54a4941aff06-kube-api-access-w2tzk\") pod \"perf-node-gather-daemonset-54tbn\" (UID: \"8474167c-2f36-4d10-8964-54a4941aff06\") " pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.827920 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.827846    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:49.959752 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.959721    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cb757cd9b-n89wz_bdadd270-b08c-483e-bb97-7131e4424daa/console/0.log"
Jul 09 10:59:49.960434 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:49.960414    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"]
Jul 09 10:59:49.963064 ip-10-0-128-170 kubenswrapper[2585]: W0709 10:59:49.963041    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8474167c_2f36_4d10_8964_54a4941aff06.slice/crio-abc021e69eec38c93f7ef0a5285ea1b183e18063747f9bf499b6a15805b0257d WatchSource:0}: Error finding container abc021e69eec38c93f7ef0a5285ea1b183e18063747f9bf499b6a15805b0257d: Status 404 returned error can't find the container with id abc021e69eec38c93f7ef0a5285ea1b183e18063747f9bf499b6a15805b0257d
Jul 09 10:59:50.016227 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:50.016203    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-j5m2p_d8b57aa2-ca85-4d76-ab3f-7807db131fdb/download-server/0.log"
Jul 09 10:59:50.390324 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:50.390291    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn" event={"ID":"8474167c-2f36-4d10-8964-54a4941aff06","Type":"ContainerStarted","Data":"73f8c6d9a2026097400653bb42857e3ad13fbbfae85f2a1295e0af0458d5fd8f"}
Jul 09 10:59:50.390508 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:50.390339    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn" event={"ID":"8474167c-2f36-4d10-8964-54a4941aff06","Type":"ContainerStarted","Data":"abc021e69eec38c93f7ef0a5285ea1b183e18063747f9bf499b6a15805b0257d"}
Jul 09 10:59:50.390508 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:50.390365    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:50.408534 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:50.408491    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn" podStartSLOduration=1.408477388 podStartE2EDuration="1.408477388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 10:59:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 10:59:50.407284258 +0000 UTC m=+5168.525644081" watchObservedRunningTime="2026-07-09 10:59:50.408477388 +0000 UTC m=+5168.526837218"
Jul 09 10:59:51.659416 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:51.659385    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wrxt4_4228cd80-ca4e-4b5c-b083-c0348ddfdb57/dns/0.log"
Jul 09 10:59:51.681100 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:51.681075    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wrxt4_4228cd80-ca4e-4b5c-b083-c0348ddfdb57/kube-rbac-proxy/0.log"
Jul 09 10:59:51.755509 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:51.755483    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z8fr5_f7239d49-2a5a-43dd-ba67-ccb7535bd293/dns-node-resolver/0.log"
Jul 09 10:59:52.330778 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:52.330736    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8wthl_24e6c876-35de-40d7-9aa9-89577ef79ea7/node-ca/0.log"
Jul 09 10:59:53.664124 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:53.664065    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/5.log"
Jul 09 10:59:53.677721 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:53.677697    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/6.log"
Jul 09 10:59:54.239907 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:54.239874    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lgl65_649acb02-775d-40c1-9e70-dd7ca087e7ff/serve-healthcheck-canary/0.log"
Jul 09 10:59:54.939976 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:54.939952    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvqd8_dce7b893-247b-49dc-8a33-b33442f79218/kube-rbac-proxy/0.log"
Jul 09 10:59:54.964299 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:54.964270    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvqd8_dce7b893-247b-49dc-8a33-b33442f79218/exporter/0.log"
Jul 09 10:59:54.987593 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:54.987565    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvqd8_dce7b893-247b-49dc-8a33-b33442f79218/extractor/0.log"
Jul 09 10:59:56.405265 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:56.405236    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d8w7l/perf-node-gather-daemonset-54tbn"
Jul 09 10:59:57.780737 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:57.780703    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-599d46c4cb-pkpkn_2f4e88e5-7912-445a-a91c-dfd774682419/manager/0.log"
Jul 09 10:59:57.806057 ip-10-0-128-170 kubenswrapper[2585]: I0709 10:59:57.806024    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-559pb_5593aec1-71c7-4a2a-87c2-5be7cbcc3b04/openshift-lws-operator/0.log"
Jul 09 11:00:00.823494 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:00.823463    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/5.log"
Jul 09 11:00:00.838138 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:00.838113    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/6.log"
Jul 09 11:00:02.272917 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:02.272879    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/5.log"
Jul 09 11:00:02.286707 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:02.286679    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-655f7c58b4-962b9_82f7a1dd-03f9-4af1-9911-910e51bd241d/istio-proxy/6.log"
Jul 09 11:00:05.951497 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:05.951472    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jdfh_de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10/kube-multus-additional-cni-plugins/0.log"
Jul 09 11:00:05.972637 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:05.972615    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jdfh_de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10/egress-router-binary-copy/0.log"
Jul 09 11:00:05.993134 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:05.993114    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jdfh_de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10/cni-plugins/0.log"
Jul 09 11:00:06.013727 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:06.013704    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jdfh_de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10/bond-cni-plugin/0.log"
Jul 09 11:00:06.035307 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:06.035284    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jdfh_de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10/routeoverride-cni/0.log"
Jul 09 11:00:06.061215 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:06.061171    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jdfh_de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10/whereabouts-cni-bincopy/0.log"
Jul 09 11:00:06.083500 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:06.083482    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jdfh_de9ac9bd-f3e0-40f4-99ff-a285dcfb9c10/whereabouts-cni/0.log"
Jul 09 11:00:06.286005 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:06.285930    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b9jth_ebcd178a-b784-413e-9ace-21252e141ddc/kube-multus/0.log"
Jul 09 11:00:06.431573 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:06.431545    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nvq9w_294a299b-397e-431f-bc41-2e95b263e091/network-metrics-daemon/0.log"
Jul 09 11:00:06.450582 ip-10-0-128-170 kubenswrapper[2585]: I0709 11:00:06.450559    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nvq9w_294a299b-397e-431f-bc41-2e95b263e091/kube-rbac-proxy/0.log"