Jul 16 17:34:51.238586 ip-10-0-128-180 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.696732    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704391    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704405    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704409    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704412    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704416    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704419    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704422    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:34:51.740775 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704425    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704428    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704430    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704434    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704437    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704439    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704442    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704448    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704453    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704456    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704461    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704465    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704476    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704480    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704483    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704486    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704489    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704492    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704495    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:34:51.742640 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704498    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704501    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704504    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704506    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704509    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704512    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704515    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704518    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704521    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704524    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704527    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704529    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704532    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704534    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704537    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704540    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704543    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704546    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704549    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704552    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704555    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:34:51.743606 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704558    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704561    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704563    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704566    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704569    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704571    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704574    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704578    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704583    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704586    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704589    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704591    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704594    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704597    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704600    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704603    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704606    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704609    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704612    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704615    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:34:51.744548 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704618    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704620    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704623    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704626    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704630    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704633    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704638    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704640    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704643    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704646    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704648    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704651    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704654    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704657    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704660    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704663    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704666    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704670    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704675    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:34:51.747886 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704679    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704682    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704685    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704688    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704691    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704695    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704698    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704701    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704704    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704707    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704710    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704712    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.704715    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705546    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705554    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705558    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705561    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705565    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705569    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705572    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:34:51.748852 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705576    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705579    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705582    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705584    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705587    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705590    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705595    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705600    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705603    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705607    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705610    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705614    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705617    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705620    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705623    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705626    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705629    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705633    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705637    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:34:51.757156 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705640    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705643    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705646    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705649    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705652    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705654    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705657    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705660    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705663    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705665    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705669    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705672    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705675    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705678    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705680    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705684    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705686    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705689    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705692    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705695    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:34:51.758124 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705699    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705702    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705704    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705707    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705710    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705713    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705715    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705718    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705721    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705724    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705727    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705731    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705734    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705738    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705741    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705744    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705747    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705749    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705752    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705754    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:34:51.759096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705757    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705760    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705763    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705766    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705769    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705773    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705776    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705779    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705781    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705784    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705787    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705790    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705793    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705796    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705798    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705801    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705804    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705807    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705810    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705813    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:34:51.760059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705816    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705818    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705822    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705826    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705829    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705832    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705835    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705838    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705841    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705843    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705846    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705849    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.705854    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706278    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706284    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706287    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706290    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706295    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706298    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706302    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:34:51.761020 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706305    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706309    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706312    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706315    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706319    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706322    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706325    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706328    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706331    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706334    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706336    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706340    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706343    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706345    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706348    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706351    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706370    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706374    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706377    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706381    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:34:51.762003 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706383    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706386    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706391    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706394    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706400    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706403    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706406    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706410    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706413    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706417    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706421    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706424    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706428    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706431    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706434    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706436    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706439    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706442    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706445    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:34:51.762960 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706448    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706451    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706453    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706456    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706460    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706464    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706467    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706471    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706476    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706479    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706482    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706485    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706488    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706490    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706493    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706496    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706499    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706503    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706506    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706509    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:34:51.763924 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706512    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706514    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706517    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706520    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706523    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706526    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706529    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706531    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706534    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706537    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706539    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706542    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706545    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706548    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706550    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706553    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706555    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706558    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706561    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706564    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:34:51.764887 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706568    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706571    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706574    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706576    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706579    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706582    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706585    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706587    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706590    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706594    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706597    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706599    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.706602    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706676    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706684    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706690    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706695    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706701    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706705    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706710    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706715    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 17:34:51.765853 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706718    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706722    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706726    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706729    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706732    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706736    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706739    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706742    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706745    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706748    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706753    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706758    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706762    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706765    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706768    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706772    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706776    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706779    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706783    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706786    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706790    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706794    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706797    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706800    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 17:34:51.766822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706805    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706808    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706811    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706814    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706817    2580 flags.go:64] FLAG: --enable-server="true"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706821    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706826    2580 flags.go:64] FLAG: --event-burst="100"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706829    2580 flags.go:64] FLAG: --event-qps="50"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706832    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706836    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706839    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706843    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706846    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706849    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706852    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706855    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706858    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706861    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706864    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706869    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706872    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706875    2580 flags.go:64] FLAG: --feature-gates=""
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706879    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706882    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706885    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 17:34:51.768043 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706888    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706892    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706895    2580 flags.go:64] FLAG: --help="false"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706901    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-180.ec2.internal"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706905    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706908    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706911    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706914    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706918    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706921    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706924    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706927    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706931    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706934    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706938    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706941    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706944    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706947    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706951    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706954    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706957    2580 flags.go:64] FLAG: --lock-file=""
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706960    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706963    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706966    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 17:34:51.769251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706971    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706975    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706979    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706982    2580 flags.go:64] FLAG: --logging-format="text"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706985    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706989    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706992    2580 flags.go:64] FLAG: --manifest-url=""
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706995    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.706999    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707003    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707007    2580 flags.go:64] FLAG: --max-pods="110"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707012    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707015    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707019    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707022    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707025    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707028    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707031    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707039    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707042    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707046    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707049    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707054    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 17:34:51.770714 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707060    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707063    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707066    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707069    2580 flags.go:64] FLAG: --port="10250"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707073    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707076    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d50706cdfc951461"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707080    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707083    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707086    2580 flags.go:64] FLAG: --register-node="true"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707089    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707094    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707098    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707102    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707105    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707108    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707112    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707115    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707118    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707121    2580 flags.go:64] FLAG: --runonce="false"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707124    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707127    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707132    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707135    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707138    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707141    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707144    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 17:34:51.771902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707148    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707151    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707154    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707157    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707160    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707164    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707167    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707171    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707176    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707179    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707182    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707187    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707190    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707193    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707196    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707199    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707202    2580 flags.go:64] FLAG: --v="2"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707207    2580 flags.go:64] FLAG: --version="false"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707212    2580 flags.go:64] FLAG: --vmodule=""
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707219    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.707223    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707373    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707379    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707384    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:34:51.773098 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707389    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707392    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707395    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707400    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707403    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707408    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707412    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707415    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707418    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707421    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707424    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707427    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707430    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707433    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707436    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707439    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707442    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707446    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707451    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:34:51.774307 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707454    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707457    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707460    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707462    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707465    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707468    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707472    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707475    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707478    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707480    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707483    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707488    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707491    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707495    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707498    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707502    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707506    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707509    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707512    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:34:51.775262 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707515    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707518    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707521    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707524    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707527    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707529    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707532    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707535    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707538    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707541    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707545    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707547    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707550    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707553    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707555    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707558    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707561    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707564    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707566    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707570    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:34:51.776238 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707573    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707576    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707579    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707582    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707585    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707587    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707590    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707593    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707595    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707599    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707602    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707605    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707608    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707611    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707613    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707616    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707619    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707622    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707625    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:34:51.777376 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707628    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707630    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707633    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707636    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707642    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707645    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707648    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707651    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707653    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707656    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707659    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707661    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707665    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707668    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707671    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707674    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707676    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707679    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:34:51.871774 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.707682    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:34:51.830987 ip-10-0-128-180 systemd[1]: Started Kubernetes Kubelet.
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.708944    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.716937    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.716953    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.716971    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.716977    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717037    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717044    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717048    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717052    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717055    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717059    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717062    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717065    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:34:51.872844 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717068    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717071    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717074    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717077    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717081    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717083    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717086    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717089    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717092    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717095    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717098    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717103    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717106    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717109    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717112    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717114    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717117    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717120    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717123    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:34:51.874266 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717126    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717129    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717132    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717135    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717137    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717140    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717144    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717148    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717152    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717154    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717157    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717160    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717163    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717166    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717169    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717172    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717174    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717177    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717181    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717184    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:34:51.875230 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717186    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717191    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717194    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717197    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717201    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717204    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717207    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717210    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717212    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717215    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717218    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717221    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717224    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717227    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717229    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717232    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717235    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717238    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717240    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717244    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:34:51.876778 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717246    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717249    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717252    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717255    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717257    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717260    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717263    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717266    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717268    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717271    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717274    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717277    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717280    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717284    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717286    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717289    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717294    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717297    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717299    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717302    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:34:51.877906 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717305    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717308    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717311    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717313    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717317    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717321    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717325    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717328    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717331    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717334    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717337    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717340    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.717346    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717494    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:34:51.883378 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717499    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717504    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717508    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717512    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717515    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717517    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717520    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717523    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717525    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717528    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717531    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717536    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717539    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717542    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717544    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717548    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717551    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717554    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717557    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:34:51.884281 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717560    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717562    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717565    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717568    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717570    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717574    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717578    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717581    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717584    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717587    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717590    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717593    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717596    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717598    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717601    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717604    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717607    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717609    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717612    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717615    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:34:51.886171 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717618    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717621    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717623    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717626    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717631    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717634    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717636    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717639    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717643    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717646    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717649    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717651    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717654    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717657    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717660    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717663    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717665    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717668    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717671    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717674    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:34:51.887144 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717676    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717679    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717682    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717685    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717687    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717690    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717693    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717696    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717700    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717704    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717707    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717709    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717713    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717716    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717719    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717722    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717726    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717730    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717733    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717735    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:34:51.888721 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717740    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717743    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717745    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717748    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717751    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717754    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717757    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717759    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717762    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717765    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717767    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717770    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717773    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717776    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717779    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717781    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717784    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717787    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:34:51.975383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:51.717790    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.717795    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.717916    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.720129    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.721771    2580 server.go:1019] "Starting client certificate rotation"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.721885    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.723141    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.725566    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.726831    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.762875    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.793602    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.796765    2580 log.go:25] "Validated CRI v1 image API"
Jul 16 17:34:51.976786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.797678    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 17:34:51.977516 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.801394    2580 fs.go:135] Filesystem UUIDs: map[09480fe1-69c6-45ae-97d8-7f293190418d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b371e492-8d0d-4d54-8264-d5841a00e330:/dev/nvme0n1p4]
Jul 16 17:34:51.977516 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.801421    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.808345    2580 manager.go:216] Machine: {Timestamp:2026-07-16 17:34:51.806513474 +0000 UTC m=+0.442715436 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100126 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22aeb07f46c2d2e58f39c9ab872f22 SystemUUID:ec22aeb0-7f46-c2d2-e58f-39c9ab872f22 BootID:82c3d16e-e1ab-4246-b617-e28add7d2981 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:0a:18:7f:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:0a:18:7f:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:bc:85:c3:26:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.808471    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.808595    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.813531    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.813562    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-180.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.814377    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.814389    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.814397    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.815220    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.816577    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.817404    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d2kgs"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.819475    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.819607    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.819640    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.819653    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.819670    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 17:34:51.978915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.819682    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.819693    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.820075    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.820092    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.822765    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.824832    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.824872    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825048    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825065    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825074    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825082    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825095    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825105    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825770    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825779    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825788    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825796    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825808    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825819    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825842    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.825849    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.830033    2580 server.go:1268] "Started kubelet"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.831509    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.833420    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.845419    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.845868    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.847458    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d2kgs"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.847835    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.850168    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-180.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:51.850843    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:51.850843    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:51.850057    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-180.ec2.internal.18c2d5a1758173d0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-180.ec2.internal,UID:ip-10-0-128-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-180.ec2.internal,},FirstTimestamp:2026-07-16 17:34:51.830006736 +0000 UTC m=+0.466208699,LastTimestamp:2026-07-16 17:34:51.830006736 +0000 UTC m=+0.466208699,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-180.ec2.internal,}"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:51.852661    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.852767    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.852791    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:51.852858    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.853354    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.853354    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.853381    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.853489    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.853499    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 17:34:51.979875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.853756    2580 factory.go:55] Registering systemd factory
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.853773    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.854101    2580 factory.go:153] Registering CRI-O factory
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.854117    2580 factory.go:223] Registration of the crio container factory successfully
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.854218    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.854248    2580 factory.go:103] Registering Raw factory
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.854280    2580 manager.go:1196] Started watching for new ooms in manager
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.854816    2580 manager.go:349] Starting recovery of all containers
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.857389    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:51.862211    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-180.ec2.internal\" not found" node="ip-10-0-128-180.ec2.internal"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.911943    2580 manager.go:354] Recovery completed
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.927839    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.930118    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.930154    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.930169    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.930950    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.930962    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.930982    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.932419    2580 policy_none.go:49] "None policy: Start"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.932434    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.932447    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.933778    2580 policy_none.go:47] "Start"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.934579    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.935597    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.935624    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:51.935634    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:34:51.983231 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:51.953378    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.031207    2580 manager.go:337] "Starting Device Plugin manager"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.031243    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.031254    2580 server.go:87] "Starting device plugin registration server"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.031549    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.031561    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.031654    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.031745    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.031753    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.039593    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 17:34:52.117121 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.039642    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.137809    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.139041    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.139064    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.139074    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.139104    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.157152    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.157174    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-180.ec2.internal\": node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.179992    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.185099    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.186785    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.186819    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.186840    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.186875    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 17:34:52.253833 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.188880    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.281891    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.287391    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal"]
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.287467    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.290500    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.290525    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.290535    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.292605    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.293009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.293034    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.293762    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.293782    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.293792    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.295465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.295486    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.295609    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.295623    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.295632    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.296363    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.296382    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.296391    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.328424    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-180.ec2.internal\" not found" node="ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.333351    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-180.ec2.internal\" not found" node="ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.357443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d499f38d02bf2d58d9904b938bbf0a88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal\" (UID: \"d499f38d02bf2d58d9904b938bbf0a88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.357470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d499f38d02bf2d58d9904b938bbf0a88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal\" (UID: \"d499f38d02bf2d58d9904b938bbf0a88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.368002 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.357488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a54a8192d9cf200817bbc08086882740-config\") pod \"kube-apiserver-proxy-ip-10-0-128-180.ec2.internal\" (UID: \"a54a8192d9cf200817bbc08086882740\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.382167    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.458502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a54a8192d9cf200817bbc08086882740-config\") pod \"kube-apiserver-proxy-ip-10-0-128-180.ec2.internal\" (UID: \"a54a8192d9cf200817bbc08086882740\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.458545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d499f38d02bf2d58d9904b938bbf0a88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal\" (UID: \"d499f38d02bf2d58d9904b938bbf0a88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.458562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d499f38d02bf2d58d9904b938bbf0a88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal\" (UID: \"d499f38d02bf2d58d9904b938bbf0a88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.458625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a54a8192d9cf200817bbc08086882740-config\") pod \"kube-apiserver-proxy-ip-10-0-128-180.ec2.internal\" (UID: \"a54a8192d9cf200817bbc08086882740\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.458697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d499f38d02bf2d58d9904b938bbf0a88-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal\" (UID: \"d499f38d02bf2d58d9904b938bbf0a88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.458727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d499f38d02bf2d58d9904b938bbf0a88-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal\" (UID: \"d499f38d02bf2d58d9904b938bbf0a88\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.491328 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.483608    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.637013 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.585706    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.637013 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.633502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.637013 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.636041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:52.761841 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.686833    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.761841 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.722674    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 17:34:52.761841 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.722860    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:34:52.761841 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.722899    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:34:52.882677 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.788145    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:52.882677 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.855216    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:29:52 +0000 UTC" deadline="2027-12-16 07:37:32.130641116 +0000 UTC"
Jul 16 17:34:52.882677 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.855241    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12422h2m39.275403198s"
Jul 16 17:34:53.011695 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.888915    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:53.011695 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:52.989333    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-180.ec2.internal\" not found"
Jul 16 17:34:53.011695 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:52.999944    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:34:53.053641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.053602    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:53.071032 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.071007    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:34:53.073351 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.073336    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal"
Jul 16 17:34:53.088025 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.088006    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:34:53.120633 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.120606    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:34:53.265045 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:53.264971    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd499f38d02bf2d58d9904b938bbf0a88.slice/crio-121e560cac3547959b97dfe46c487d248c0a8f4f67f1d4691332c45d2a7921b2 WatchSource:0}: Error finding container 121e560cac3547959b97dfe46c487d248c0a8f4f67f1d4691332c45d2a7921b2: Status 404 returned error can't find the container with id 121e560cac3547959b97dfe46c487d248c0a8f4f67f1d4691332c45d2a7921b2
Jul 16 17:34:53.270262 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.270237    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:34:53.822740 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.822717    2580 apiserver.go:52] "Watching apiserver"
Jul 16 17:34:53.831251 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.831229    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 17:34:53.831641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.831617    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qjhmr","kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal","openshift-cluster-node-tuning-operator/tuned-whwbj","openshift-multus/multus-additional-cni-plugins-4flfv","openshift-multus/multus-kjh44","openshift-multus/network-metrics-daemon-5dnnt","openshift-network-operator/iptables-alerter-7xfrf","kube-system/konnectivity-agent-6cg2l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc","openshift-dns/node-resolver-7xkbj","openshift-image-registry/node-ca-f4wxn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal","openshift-network-diagnostics/network-check-target-7xlv6","openshift-ovn-kubernetes/ovnkube-node-2vqpm"]
Jul 16 17:34:53.834140 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.834121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.835291 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.835268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:53.835438 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.835374    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:34:53.836577 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.836561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.837786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.837769    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 17:34:53.837924 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.837906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.838110 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.838083    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jqjqk\""
Jul 16 17:34:53.838110 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.838101    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 17:34:53.838284 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.838118    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:34:53.838836 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.838816    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kv2zl\""
Jul 16 17:34:53.838923 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.838854    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 17:34:53.839179 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.839157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.839565 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.839546    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:34:53.840568 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.840551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:53.840664 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.840617    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:34:53.841240 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.841222    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 17:34:53.841453 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.841420    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 17:34:53.841583 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.841501    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 17:34:53.841583 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.841525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qjg4m\""
Jul 16 17:34:53.841784 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.841762    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 17:34:53.842285 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.841989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.842687 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.842664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 17:34:53.842768 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.842744    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 17:34:53.843366 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.843344    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.843462 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.843419    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:34:53.844106 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.844074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jks2b\""
Jul 16 17:34:53.845812 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.845594    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 17:34:53.845812 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.845750    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-98kn6\""
Jul 16 17:34:53.846655 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.846633    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.847294 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.847273    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 17:34:53.847923 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.847898    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 17:34:53.848997 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.848975    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.850309 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.850289    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nczq4\""
Jul 16 17:34:53.850409 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.850359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.850757 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.850736    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 17:34:53.850836 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.850822    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 17:34:53.850895 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.850881    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 17:34:53.851717 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.851698    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xm2dz\""
Jul 16 17:34:53.851804 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.851746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 17:34:53.851804 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.851706    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 17:34:53.851921 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.851706    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 17:34:53.851921 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.851890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 17:34:53.852102 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.852083    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 17:34:53.852200 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.852154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:53.852693 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.852679    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 17:34:53.853375 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.853360    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 17:34:53.854641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.854625    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 17:34:53.854878 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.854804    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 17:34:53.854878 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.854839    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 17:34:53.855009 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.854900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4rzn8\""
Jul 16 17:34:53.855170 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.855140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l55hw\""
Jul 16 17:34:53.855270 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.855147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 17:34:53.855270 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.855209    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 17:34:53.867621 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.867621 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-sys-fs\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.867758 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-slash\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.867758 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4236932-fd85-4813-83ca-970f019c66e1-konnectivity-ca\") pod \"konnectivity-agent-6cg2l\" (UID: \"a4236932-fd85-4813-83ca-970f019c66e1\") " pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:53.867758 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysctl-d\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.867758 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f01a638-b7bd-47d5-801a-203607d0adc8-host-slash\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.867899 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm7zj\" (UniqueName: \"kubernetes.io/projected/8f01a638-b7bd-47d5-801a-203607d0adc8-kube-api-access-fm7zj\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.867899 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-hostroot\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.867899 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-node-log\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.867899 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.867899 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-lib-modules\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868068 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-var-lib-kubelet\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868068 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-etc-kubernetes\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868068 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-etc-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868068 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.867965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-tmp\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868068 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.868068 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-multus-certs\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8kbz\" (UniqueName: \"kubernetes.io/projected/b2cd0c26-0ee6-4e7b-a208-397602a25675-kube-api-access-x8kbz\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:53.868263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-socket-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.868263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-cni-bin\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4236932-fd85-4813-83ca-970f019c66e1-agent-certs\") pod \"konnectivity-agent-6cg2l\" (UID: \"a4236932-fd85-4813-83ca-970f019c66e1\") " pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:53.868263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzskf\" (UniqueName: \"kubernetes.io/projected/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-kube-api-access-bzskf\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-system-cni-dir\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-os-release\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-hosts-file\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovnkube-config\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a4d2858-5981-43ea-bffa-97593ee9622d-serviceca\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-tuned\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-cnibin\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.868484 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-cni-binary-copy\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-daemon-config\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hntnd\" (UniqueName: \"kubernetes.io/projected/e8c826b6-1c4e-4749-91b6-170866ce4918-kube-api-access-hntnd\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-cnibin\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jmbz\" (UniqueName: \"kubernetes.io/projected/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-kube-api-access-9jmbz\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysconfig\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-host\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-system-cni-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-k8s-cni-cncf-io\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovnkube-script-lib\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-run\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-netns\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bda17bb-33c0-42f5-aaef-24aa7c479563-dbus\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-var-lib-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovn-node-metrics-cert\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-kubelet\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.868876 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-run-netns\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95l2p\" (UniqueName: \"kubernetes.io/projected/49445d2d-147c-493c-8fcc-5fbe0687c337-kube-api-access-95l2p\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-cni-bin\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-device-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-systemd\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.868993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqtz\" (UniqueName: \"kubernetes.io/projected/2a4d2858-5981-43ea-bffa-97593ee9622d-kube-api-access-4mqtz\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-cni-binary-copy\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-registration-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-systemd\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-kubelet\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bda17bb-33c0-42f5-aaef-24aa7c479563-kubelet-config\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-systemd-units\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-log-socket\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbzp\" (UniqueName: \"kubernetes.io/projected/7e0622d5-6433-4682-8ba3-df91b3f9e190-kube-api-access-jxbzp\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.869542 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f01a638-b7bd-47d5-801a-203607d0adc8-iptables-alerter-script\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-kubernetes\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-cni-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-socket-dir-parent\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-cni-multus\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-env-overrides\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a4d2858-5981-43ea-bffa-97593ee9622d-host\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-modprobe-d\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-sys\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-os-release\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-conf-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-tmp-dir\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-ovn\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-cni-netd\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysctl-conf\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.870182 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.870844 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.869675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnm7n\" (UniqueName: \"kubernetes.io/projected/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-kube-api-access-qnm7n\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.877001 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.876982    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:34:53.888953 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.888938    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:34:53.902518 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.902497    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xql4t"
Jul 16 17:34:53.910698 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.910676    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xql4t"
Jul 16 17:34:53.970914 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.970874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnm7n\" (UniqueName: \"kubernetes.io/projected/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-kube-api-access-qnm7n\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.970914 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.970910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.971167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.970936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-sys-fs\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.971167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-sys-fs\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.971167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.971167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-slash\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.971167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-slash\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.971167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4236932-fd85-4813-83ca-970f019c66e1-konnectivity-ca\") pod \"konnectivity-agent-6cg2l\" (UID: \"a4236932-fd85-4813-83ca-970f019c66e1\") " pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysctl-d\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f01a638-b7bd-47d5-801a-203607d0adc8-host-slash\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm7zj\" (UniqueName: \"kubernetes.io/projected/8f01a638-b7bd-47d5-801a-203607d0adc8-kube-api-access-fm7zj\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-hostroot\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-node-log\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f01a638-b7bd-47d5-801a-203607d0adc8-host-slash\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysctl-d\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-node-log\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-hostroot\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.971519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-lib-modules\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-var-lib-kubelet\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-var-lib-kubelet\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-etc-kubernetes\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-lib-modules\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-etc-kubernetes\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-etc-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4236932-fd85-4813-83ca-970f019c66e1-konnectivity-ca\") pod \"konnectivity-agent-6cg2l\" (UID: \"a4236932-fd85-4813-83ca-970f019c66e1\") " pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-tmp\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-multus-certs\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8kbz\" (UniqueName: \"kubernetes.io/projected/b2cd0c26-0ee6-4e7b-a208-397602a25675-kube-api-access-x8kbz\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-socket-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-cni-bin\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4236932-fd85-4813-83ca-970f019c66e1-agent-certs\") pod \"konnectivity-agent-6cg2l\" (UID: \"a4236932-fd85-4813-83ca-970f019c66e1\") " pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-etc-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.972062 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzskf\" (UniqueName: \"kubernetes.io/projected/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-kube-api-access-bzskf\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-multus-certs\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-system-cni-dir\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-os-release\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.971993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-hosts-file\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovnkube-config\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a4d2858-5981-43ea-bffa-97593ee9622d-serviceca\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972076    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-socket-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-tuned\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-cnibin\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-system-cni-dir\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-cni-binary-copy\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-hosts-file\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-daemon-config\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-os-release\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.972920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hntnd\" (UniqueName: \"kubernetes.io/projected/e8c826b6-1c4e-4749-91b6-170866ce4918-kube-api-access-hntnd\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-cnibin\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jmbz\" (UniqueName: \"kubernetes.io/projected/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-kube-api-access-9jmbz\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysconfig\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-host\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-system-cni-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-k8s-cni-cncf-io\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovnkube-script-lib\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-run\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-netns\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bda17bb-33c0-42f5-aaef-24aa7c479563-dbus\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-cni-bin\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-var-lib-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovn-node-metrics-cert\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bda17bb-33c0-42f5-aaef-24aa7c479563-dbus\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a4d2858-5981-43ea-bffa-97593ee9622d-serviceca\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-kubelet\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.973869 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-run-netns\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-kubelet\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95l2p\" (UniqueName: \"kubernetes.io/projected/49445d2d-147c-493c-8fcc-5fbe0687c337-kube-api-access-95l2p\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysconfig\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-cni-bin\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972891    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovnkube-config\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-device-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-systemd\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.972838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-var-lib-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.973044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-cni-bin\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.973055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-run\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.973089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-openvswitch\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.973099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-systemd\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.973089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-cnibin\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.973125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-cnibin\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.973788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-daemon-config\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.974750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-k8s-cni-cncf-io\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqtz\" (UniqueName: \"kubernetes.io/projected/2a4d2858-5981-43ea-bffa-97593ee9622d-kube-api-access-4mqtz\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-cni-binary-copy\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-registration-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-systemd\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-kubelet\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bda17bb-33c0-42f5-aaef-24aa7c479563-kubelet-config\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.974830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-cni-binary-copy\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-systemd-units\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-log-socket\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbzp\" (UniqueName: \"kubernetes.io/projected/7e0622d5-6433-4682-8ba3-df91b3f9e190-kube-api-access-jxbzp\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f01a638-b7bd-47d5-801a-203607d0adc8-iptables-alerter-script\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-kubernetes\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-cni-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovnkube-script-lib\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.975641 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-socket-dir-parent\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-cni-multus\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-env-overrides\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a4d2858-5981-43ea-bffa-97593ee9622d-host\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-modprobe-d\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-sys\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-host\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.975980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bda17bb-33c0-42f5-aaef-24aa7c479563-kubelet-config\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-os-release\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-conf-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-tmp-dir\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-registration-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-ovn\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-cni-netd\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.976445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-systemd\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysctl-conf\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-system-cni-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4236932-fd85-4813-83ca-970f019c66e1-agent-certs\") pod \"konnectivity-agent-6cg2l\" (UID: \"a4236932-fd85-4813-83ca-970f019c66e1\") " pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-tmp\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-kubernetes\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-cni-multus\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.976943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-cni-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-device-dir\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-cni-netd\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.977115    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:53.977244 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-var-lib-kubelet\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.977290    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.977447    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret podName:0bda17bb-33c0-42f5-aaef-24aa7c479563 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:54.477341844 +0000 UTC m=+3.113543812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret") pod "global-pull-secret-syncer-qjhmr" (UID: "0bda17bb-33c0-42f5-aaef-24aa7c479563") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8c826b6-1c4e-4749-91b6-170866ce4918-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-run-ovn\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-socket-dir-parent\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f01a638-b7bd-47d5-801a-203607d0adc8-iptables-alerter-script\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-host-run-netns\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.977829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-host-run-netns\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.977822    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:54.477786849 +0000 UTC m=+3.113988816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49445d2d-147c-493c-8fcc-5fbe0687c337-os-release\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-systemd-units\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.977970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e0622d5-6433-4682-8ba3-df91b3f9e190-log-socket\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-sysctl-conf\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-modprobe-d\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a4d2858-5981-43ea-bffa-97593ee9622d-host\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-sys\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e0622d5-6433-4682-8ba3-df91b3f9e190-env-overrides\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.978265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-etc-tuned\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.978852 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-multus-conf-dir\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.978852 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-tmp-dir\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.978852 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.978409    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49445d2d-147c-493c-8fcc-5fbe0687c337-cni-binary-copy\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:53.979770 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.979730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e0622d5-6433-4682-8ba3-df91b3f9e190-ovn-node-metrics-cert\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.985014 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.984989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnm7n\" (UniqueName: \"kubernetes.io/projected/b1b04fd5-0f3c-4280-bbe6-21eaa8f37067-kube-api-access-qnm7n\") pod \"node-resolver-7xkbj\" (UID: \"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067\") " pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:53.985945 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.985918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzskf\" (UniqueName: \"kubernetes.io/projected/4d4a3edf-2604-4ca5-8375-448c6dddd8d5-kube-api-access-bzskf\") pod \"tuned-whwbj\" (UID: \"4d4a3edf-2604-4ca5-8375-448c6dddd8d5\") " pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:53.986512 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.986485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hntnd\" (UniqueName: \"kubernetes.io/projected/e8c826b6-1c4e-4749-91b6-170866ce4918-kube-api-access-hntnd\") pod \"aws-ebs-csi-driver-node-bmmmc\" (UID: \"e8c826b6-1c4e-4749-91b6-170866ce4918\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:53.986600 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.986555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8kbz\" (UniqueName: \"kubernetes.io/projected/b2cd0c26-0ee6-4e7b-a208-397602a25675-kube-api-access-x8kbz\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:53.987758 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.987740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm7zj\" (UniqueName: \"kubernetes.io/projected/8f01a638-b7bd-47d5-801a-203607d0adc8-kube-api-access-fm7zj\") pod \"iptables-alerter-7xfrf\" (UID: \"8f01a638-b7bd-47d5-801a-203607d0adc8\") " pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:53.989711 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.989689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbzp\" (UniqueName: \"kubernetes.io/projected/7e0622d5-6433-4682-8ba3-df91b3f9e190-kube-api-access-jxbzp\") pod \"ovnkube-node-2vqpm\" (UID: \"7e0622d5-6433-4682-8ba3-df91b3f9e190\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:53.990042 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.990026    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:34:53.990123 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.990048    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:34:53.990123 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.990062    2580 projected.go:196] Error preparing data for projected volume kube-api-access-trtkt for pod openshift-network-diagnostics/network-check-target-7xlv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:53.990219 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:53.990149    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt podName:6f925e92-968e-48b4-b8b2-d377fe337bd1 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:54.49013298 +0000 UTC m=+3.126334978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-trtkt" (UniqueName: "kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt") pod "network-check-target-7xlv6" (UID: "6f925e92-968e-48b4-b8b2-d377fe337bd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:53.991630 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.991611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqtz\" (UniqueName: \"kubernetes.io/projected/2a4d2858-5981-43ea-bffa-97593ee9622d-kube-api-access-4mqtz\") pod \"node-ca-f4wxn\" (UID: \"2a4d2858-5981-43ea-bffa-97593ee9622d\") " pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:53.993205 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.993187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jmbz\" (UniqueName: \"kubernetes.io/projected/e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f-kube-api-access-9jmbz\") pod \"multus-kjh44\" (UID: \"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f\") " pod="openshift-multus/multus-kjh44"
Jul 16 17:34:53.993612 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:53.993592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95l2p\" (UniqueName: \"kubernetes.io/projected/49445d2d-147c-493c-8fcc-5fbe0687c337-kube-api-access-95l2p\") pod \"multus-additional-cni-plugins-4flfv\" (UID: \"49445d2d-147c-493c-8fcc-5fbe0687c337\") " pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:54.147460 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.147356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7xfrf"
Jul 16 17:34:54.153778 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.153737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4flfv"
Jul 16 17:34:54.158009 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:54.157973    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f01a638_b7bd_47d5_801a_203607d0adc8.slice/crio-6ae6938d76427894240065c6ec9d2d3217e1ccb193baa2112935ba9104b3785a WatchSource:0}: Error finding container 6ae6938d76427894240065c6ec9d2d3217e1ccb193baa2112935ba9104b3785a: Status 404 returned error can't find the container with id 6ae6938d76427894240065c6ec9d2d3217e1ccb193baa2112935ba9104b3785a
Jul 16 17:34:54.162294 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.162138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whwbj"
Jul 16 17:34:54.164098 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:54.164068    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49445d2d_147c_493c_8fcc_5fbe0687c337.slice/crio-ceb73297abaebdcc058a1b91b2d8a49edc5edca006513212386a797e07c8b86e WatchSource:0}: Error finding container ceb73297abaebdcc058a1b91b2d8a49edc5edca006513212386a797e07c8b86e: Status 404 returned error can't find the container with id ceb73297abaebdcc058a1b91b2d8a49edc5edca006513212386a797e07c8b86e
Jul 16 17:34:54.166946 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.166782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjh44"
Jul 16 17:34:54.172859 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.172697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc"
Jul 16 17:34:54.173433 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:54.173395    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4a3edf_2604_4ca5_8375_448c6dddd8d5.slice/crio-8a3eaa47f59a9e06add1ec59dfee53d856c8fd86654f67a0dc72e360b50e46f5 WatchSource:0}: Error finding container 8a3eaa47f59a9e06add1ec59dfee53d856c8fd86654f67a0dc72e360b50e46f5: Status 404 returned error can't find the container with id 8a3eaa47f59a9e06add1ec59dfee53d856c8fd86654f67a0dc72e360b50e46f5
Jul 16 17:34:54.175229 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.175210    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:34:54.178383 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:54.178356    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37dd5db_85ae_4f5d_bdd5_f4c81bc1e36f.slice/crio-67e765814cc21560645f5f7586fed82a4f357f2f2cf5e8f31d5e056aad0de8e4 WatchSource:0}: Error finding container 67e765814cc21560645f5f7586fed82a4f357f2f2cf5e8f31d5e056aad0de8e4: Status 404 returned error can't find the container with id 67e765814cc21560645f5f7586fed82a4f357f2f2cf5e8f31d5e056aad0de8e4
Jul 16 17:34:54.178580 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.178526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:34:54.183030 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:54.183005    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c826b6_1c4e_4749_91b6_170866ce4918.slice/crio-28c501fc74ce8cd4cb04d3c5df5f7e935dfd8834c9a6b2e44c17d077fb326ec1 WatchSource:0}: Error finding container 28c501fc74ce8cd4cb04d3c5df5f7e935dfd8834c9a6b2e44c17d077fb326ec1: Status 404 returned error can't find the container with id 28c501fc74ce8cd4cb04d3c5df5f7e935dfd8834c9a6b2e44c17d077fb326ec1
Jul 16 17:34:54.184048 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.184032    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xkbj"
Jul 16 17:34:54.190049 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.190027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f4wxn"
Jul 16 17:34:54.191431 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:54.191405    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0622d5_6433_4682_8ba3_df91b3f9e190.slice/crio-85775a13089cda9adae31bca8ad8342118205b8359076040046050026f75fab8 WatchSource:0}: Error finding container 85775a13089cda9adae31bca8ad8342118205b8359076040046050026f75fab8: Status 404 returned error can't find the container with id 85775a13089cda9adae31bca8ad8342118205b8359076040046050026f75fab8
Jul 16 17:34:54.193951 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.193928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:34:54.195972 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.195927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjh44" event={"ID":"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f","Type":"ContainerStarted","Data":"67e765814cc21560645f5f7586fed82a4f357f2f2cf5e8f31d5e056aad0de8e4"}
Jul 16 17:34:54.197649 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.197618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whwbj" event={"ID":"4d4a3edf-2604-4ca5-8375-448c6dddd8d5","Type":"ContainerStarted","Data":"8a3eaa47f59a9e06add1ec59dfee53d856c8fd86654f67a0dc72e360b50e46f5"}
Jul 16 17:34:54.198618 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:34:54.198593    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b04fd5_0f3c_4280_bbe6_21eaa8f37067.slice/crio-da77585da43f8740c4e93f0addf4fd41d4c3a343c9fb99eb8aa2fd40d4d267c9 WatchSource:0}: Error finding container da77585da43f8740c4e93f0addf4fd41d4c3a343c9fb99eb8aa2fd40d4d267c9: Status 404 returned error can't find the container with id da77585da43f8740c4e93f0addf4fd41d4c3a343c9fb99eb8aa2fd40d4d267c9
Jul 16 17:34:54.199100 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.199074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerStarted","Data":"ceb73297abaebdcc058a1b91b2d8a49edc5edca006513212386a797e07c8b86e"}
Jul 16 17:34:54.200595 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.200570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7xfrf" event={"ID":"8f01a638-b7bd-47d5-801a-203607d0adc8","Type":"ContainerStarted","Data":"6ae6938d76427894240065c6ec9d2d3217e1ccb193baa2112935ba9104b3785a"}
Jul 16 17:34:54.203497 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.203426    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal" event={"ID":"d499f38d02bf2d58d9904b938bbf0a88","Type":"ContainerStarted","Data":"121e560cac3547959b97dfe46c487d248c0a8f4f67f1d4691332c45d2a7921b2"}
Jul 16 17:34:54.204832 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.204741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc" event={"ID":"e8c826b6-1c4e-4749-91b6-170866ce4918","Type":"ContainerStarted","Data":"28c501fc74ce8cd4cb04d3c5df5f7e935dfd8834c9a6b2e44c17d077fb326ec1"}
Jul 16 17:34:54.482058 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.481703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:54.482058 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.481767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:54.482058 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.482014    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:54.482346 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.482090    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:55.482069217 +0000 UTC m=+4.118271165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:54.482346 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.482102    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:54.482346 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.482175    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret podName:0bda17bb-33c0-42f5-aaef-24aa7c479563 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:55.482153886 +0000 UTC m=+4.118355836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret") pod "global-pull-secret-syncer-qjhmr" (UID: "0bda17bb-33c0-42f5-aaef-24aa7c479563") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:54.583068 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.583023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:54.583267 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.583244    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:34:54.583353 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.583276    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:34:54.583353 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.583314    2580 projected.go:196] Error preparing data for projected volume kube-api-access-trtkt for pod openshift-network-diagnostics/network-check-target-7xlv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:54.583433 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:54.583389    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt podName:6f925e92-968e-48b4-b8b2-d377fe337bd1 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:55.583368941 +0000 UTC m=+4.219570910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-trtkt" (UniqueName: "kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt") pod "network-check-target-7xlv6" (UID: "6f925e92-968e-48b4-b8b2-d377fe337bd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:54.913734 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.913627    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:29:54 +0000 UTC" deadline="2028-03-16 04:41:23.031963948 +0000 UTC"
Jul 16 17:34:54.913734 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:54.913730    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14603h6m28.118238488s"
Jul 16 17:34:55.209933 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.209683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6cg2l" event={"ID":"a4236932-fd85-4813-83ca-970f019c66e1","Type":"ContainerStarted","Data":"92c2513470af7be33a31b41201e533361f16eb3834a23fbca34cd819da79460e"}
Jul 16 17:34:55.211547 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.211455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f4wxn" event={"ID":"2a4d2858-5981-43ea-bffa-97593ee9622d","Type":"ContainerStarted","Data":"7ea99b3c801ce9e483d5108983d1c92148f9c5536d520f51736b843de7840e5f"}
Jul 16 17:34:55.213631 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.213558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xkbj" event={"ID":"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067","Type":"ContainerStarted","Data":"da77585da43f8740c4e93f0addf4fd41d4c3a343c9fb99eb8aa2fd40d4d267c9"}
Jul 16 17:34:55.215700 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.215672    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal" event={"ID":"a54a8192d9cf200817bbc08086882740","Type":"ContainerStarted","Data":"d32b785f11af0959ffc1a2f7080f23b99841bb969a1f9cac871ed71d66136ebb"}
Jul 16 17:34:55.219396 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.219369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"85775a13089cda9adae31bca8ad8342118205b8359076040046050026f75fab8"}
Jul 16 17:34:55.491741 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.491607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:55.491741 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.491707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:55.491995 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.491878    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:55.491995 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.491949    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:57.491929759 +0000 UTC m=+6.128131728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:55.492531 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.492506    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:55.492648 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.492567    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret podName:0bda17bb-33c0-42f5-aaef-24aa7c479563 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:57.492550066 +0000 UTC m=+6.128752029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret") pod "global-pull-secret-syncer-qjhmr" (UID: "0bda17bb-33c0-42f5-aaef-24aa7c479563") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:55.593237 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.593166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:55.593511 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.593451    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:34:55.593593 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.593522    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:34:55.593593 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.593537    2580 projected.go:196] Error preparing data for projected volume kube-api-access-trtkt for pod openshift-network-diagnostics/network-check-target-7xlv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:55.593708 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:55.593611    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt podName:6f925e92-968e-48b4-b8b2-d377fe337bd1 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:57.59358829 +0000 UTC m=+6.229790257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-trtkt" (UniqueName: "kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt") pod "network-check-target-7xlv6" (UID: "6f925e92-968e-48b4-b8b2-d377fe337bd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:55.914037 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.913917    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:29:54 +0000 UTC" deadline="2028-03-21 20:07:05.406367131 +0000 UTC"
Jul 16 17:34:55.914037 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:55.913972    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14738h32m9.492400099s"
Jul 16 17:34:56.189617 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:56.189529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:56.189815 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:56.189668    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:34:56.190116 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:56.190096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:56.190223 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:56.190203    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:34:56.190288 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:56.190276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:56.190414 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:56.190390    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:34:56.227457 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:56.227418    2580 generic.go:356] "Generic (PLEG): container finished" podID="d499f38d02bf2d58d9904b938bbf0a88" containerID="c54027b35b2610df48707987196c26469ad78c637d2e7e9b5da7a55dff7dd9a5" exitCode=0
Jul 16 17:34:56.227630 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:56.227471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal" event={"ID":"d499f38d02bf2d58d9904b938bbf0a88","Type":"ContainerDied","Data":"c54027b35b2610df48707987196c26469ad78c637d2e7e9b5da7a55dff7dd9a5"}
Jul 16 17:34:57.233350 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:57.233296    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal" event={"ID":"d499f38d02bf2d58d9904b938bbf0a88","Type":"ContainerStarted","Data":"65c33370fccf4e260c55048662f01bc0d8b41aee4c7918eb6571d380a55ff1f4"}
Jul 16 17:34:57.509584 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:57.509493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:57.509584 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:57.509557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:57.509833 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.509692    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:57.509833 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.509761    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:57.509833 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.509780    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret podName:0bda17bb-33c0-42f5-aaef-24aa7c479563 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:01.509754681 +0000 UTC m=+10.145956634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret") pod "global-pull-secret-syncer-qjhmr" (UID: "0bda17bb-33c0-42f5-aaef-24aa7c479563") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:34:57.509833 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.509826    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:01.509807068 +0000 UTC m=+10.146009034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:34:57.610021 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:57.609975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:57.610228 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.610186    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:34:57.610228 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.610217    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:34:57.610368 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.610236    2580 projected.go:196] Error preparing data for projected volume kube-api-access-trtkt for pod openshift-network-diagnostics/network-check-target-7xlv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:57.610368 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:57.610315    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt podName:6f925e92-968e-48b4-b8b2-d377fe337bd1 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:01.610281831 +0000 UTC m=+10.246483792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-trtkt" (UniqueName: "kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt") pod "network-check-target-7xlv6" (UID: "6f925e92-968e-48b4-b8b2-d377fe337bd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:34:58.187779 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:58.187744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:34:58.187972 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:58.187744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:34:58.187972 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:58.187894    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:34:58.188117 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:58.187996    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:34:58.188117 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:34:58.187745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:34:58.188223 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:34:58.188112    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:00.187781 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:00.187747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:00.188244 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:00.187872    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:00.188322 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:00.188311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:00.188443 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:00.188412    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:00.188573 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:00.188557    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:00.188681 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:00.188661    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:01.545680 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:01.545559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:01.545680 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:01.545609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:01.546205 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.545711    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:35:01.546205 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.545776    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret podName:0bda17bb-33c0-42f5-aaef-24aa7c479563 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:09.545758106 +0000 UTC m=+18.181960064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret") pod "global-pull-secret-syncer-qjhmr" (UID: "0bda17bb-33c0-42f5-aaef-24aa7c479563") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:35:01.546609 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.546436    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:35:01.546609 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.546514    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:09.546495737 +0000 UTC m=+18.182697688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:35:01.646662 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:01.646626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:01.646839 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.646798    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:35:01.646839 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.646816    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:35:01.646839 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.646830    2580 projected.go:196] Error preparing data for projected volume kube-api-access-trtkt for pod openshift-network-diagnostics/network-check-target-7xlv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:35:01.647036 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:01.646886    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt podName:6f925e92-968e-48b4-b8b2-d377fe337bd1 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:09.64686688 +0000 UTC m=+18.283068827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-trtkt" (UniqueName: "kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt") pod "network-check-target-7xlv6" (UID: "6f925e92-968e-48b4-b8b2-d377fe337bd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:35:02.188146 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:02.188113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:02.188358 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:02.188225    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:02.188672 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:02.188652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:02.188779 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:02.188757    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:02.188828 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:02.188817    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:02.188930 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:02.188897    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:04.187815 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:04.187778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:04.188327 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:04.187778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:04.188327 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:04.187920    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:04.188327 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:04.187779    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:04.188327 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:04.188044    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:04.188327 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:04.188122    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:06.187545 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:06.187507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:06.188004 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:06.187553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:06.188004 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:06.187519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:06.188004 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:06.187659    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:06.188004 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:06.187735    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:06.188004 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:06.187849    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:08.187558 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:08.187517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:08.188044 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:08.187517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:08.188044 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:08.187652    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:08.188044 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:08.187517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:08.188044 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:08.187719    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:08.188044 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:08.187810    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:09.612586 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:09.612553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:09.612586 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:09.612592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:09.613167 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.612712    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:35:09.613167 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.612714    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:35:09.613167 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.612777    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:25.612758818 +0000 UTC m=+34.248960764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:35:09.613167 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.612795    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret podName:0bda17bb-33c0-42f5-aaef-24aa7c479563 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:25.612786629 +0000 UTC m=+34.248988574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret") pod "global-pull-secret-syncer-qjhmr" (UID: "0bda17bb-33c0-42f5-aaef-24aa7c479563") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:35:09.713627 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:09.713584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:09.713790 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.713747    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:35:09.713790 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.713778    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:35:09.713878 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.713792    2580 projected.go:196] Error preparing data for projected volume kube-api-access-trtkt for pod openshift-network-diagnostics/network-check-target-7xlv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:35:09.713878 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:09.713847    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt podName:6f925e92-968e-48b4-b8b2-d377fe337bd1 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:25.713833206 +0000 UTC m=+34.350035165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-trtkt" (UniqueName: "kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt") pod "network-check-target-7xlv6" (UID: "6f925e92-968e-48b4-b8b2-d377fe337bd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:35:10.187784 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:10.187744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:10.187938 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:10.187747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:10.187938 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:10.187909    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:10.188108 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:10.187746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:10.188108 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:10.188022    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:10.188108 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:10.188061    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:12.188594 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:12.188558    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:12.189077 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:12.188670    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:12.189077 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:12.188993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:12.189077 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:12.189058    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:12.189239 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:12.189121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:12.189239 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:12.189191    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:14.187241 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:14.187211    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:14.187704 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:14.187211    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:14.187704 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:14.187353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:14.187704 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:14.187212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:14.187704 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:14.187390    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:14.187704 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:14.187502    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:15.266565 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.266224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc" event={"ID":"e8c826b6-1c4e-4749-91b6-170866ce4918","Type":"ContainerStarted","Data":"47a8ead0a961c8eabac4d98da62640771a28f50a783611d87faf2abd30ca62ad"}
Jul 16 17:35:15.267621 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.267598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whwbj" event={"ID":"4d4a3edf-2604-4ca5-8375-448c6dddd8d5","Type":"ContainerStarted","Data":"bbebd53e71ce53f1f64f53120b9c750bc623f661fe3e30488519cf552a968a7c"}
Jul 16 17:35:15.269063 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.269038    2580 generic.go:356] "Generic (PLEG): container finished" podID="49445d2d-147c-493c-8fcc-5fbe0687c337" containerID="0854b1872aca12b13a460324941ad244c79fc95c2acc74d7d5351bb0dce14a5e" exitCode=0
Jul 16 17:35:15.269159 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.269070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerDied","Data":"0854b1872aca12b13a460324941ad244c79fc95c2acc74d7d5351bb0dce14a5e"}
Jul 16 17:35:15.270631 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.270562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6cg2l" event={"ID":"a4236932-fd85-4813-83ca-970f019c66e1","Type":"ContainerStarted","Data":"0876fe0b90863af1482b0560f45ee18c635e1cd883bee320d464e51cc5900411"}
Jul 16 17:35:15.272017 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.271977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f4wxn" event={"ID":"2a4d2858-5981-43ea-bffa-97593ee9622d","Type":"ContainerStarted","Data":"65699c684e21b0f72b916478f33aaac9620c416dc7939ca6a66d3bba67933873"}
Jul 16 17:35:15.273628 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.273528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xkbj" event={"ID":"b1b04fd5-0f3c-4280-bbe6-21eaa8f37067","Type":"ContainerStarted","Data":"a08b84abcea0c699adade5c63c965ce15ddf6e1e4ad659e69c41e8c6bba667c5"}
Jul 16 17:35:15.275189 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.275169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjh44" event={"ID":"e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f","Type":"ContainerStarted","Data":"bf110bdaa5f3d1007cb726aef3d1ab337b69e752acd63619f9d1266284ba1787"}
Jul 16 17:35:15.276722 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.276699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal" event={"ID":"a54a8192d9cf200817bbc08086882740","Type":"ContainerStarted","Data":"8cb53e731d7549b7218e7221bcb146ff280752ebdeb063c52d2f5fbb4a5b5061"}
Jul 16 17:35:15.278873 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.278850    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:35:15.279180 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.279163    2580 generic.go:356] "Generic (PLEG): container finished" podID="7e0622d5-6433-4682-8ba3-df91b3f9e190" containerID="101e0d9d5f8818a5e2b55a4d34b412e1001a947963167d13fb99b3e87d0df096" exitCode=1
Jul 16 17:35:15.279245 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.279189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"30ff19ca68bfd10a056aa72184d984a428c70fca3cdb5cdb29844a5a10abab60"}
Jul 16 17:35:15.279245 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.279231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerDied","Data":"101e0d9d5f8818a5e2b55a4d34b412e1001a947963167d13fb99b3e87d0df096"}
Jul 16 17:35:15.279347 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.279262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"2c818e0ddce5d4bc5f68660df8302afac5fb03b95ba9dec310bedbafce0988c9"}
Jul 16 17:35:15.304788 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.304743    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-180.ec2.internal" podStartSLOduration=22.304729061 podStartE2EDuration="22.304729061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:57.265381174 +0000 UTC m=+5.901583147" watchObservedRunningTime="2026-07-16 17:35:15.304729061 +0000 UTC m=+23.940931028"
Jul 16 17:35:15.305169 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.305124    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-whwbj" podStartSLOduration=3.078667643 podStartE2EDuration="23.30511406s" totalImagesPullingTime="20.226446417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:15.304986129 +0000 UTC m=+23.941188097" watchObservedRunningTime="2026-07-16 17:35:15.30511406 +0000 UTC m=+23.941316028"
Jul 16 17:35:15.346785 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.346737    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-180.ec2.internal" podStartSLOduration=22.346722835 podStartE2EDuration="22.346722835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:15.346362133 +0000 UTC m=+23.982564100" watchObservedRunningTime="2026-07-16 17:35:15.346722835 +0000 UTC m=+23.982924803"
Jul 16 17:35:15.436042 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.435979    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7xkbj" podStartSLOduration=7.6398532 podStartE2EDuration="23.435956669s" totalImagesPullingTime="15.796103469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:15.435365636 +0000 UTC m=+24.071567605" watchObservedRunningTime="2026-07-16 17:35:15.435956669 +0000 UTC m=+24.072158639"
Jul 16 17:35:15.505871 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.505817    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f4wxn" podStartSLOduration=12.573900516 podStartE2EDuration="23.505793773s" totalImagesPullingTime="10.931893257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:15.470327525 +0000 UTC m=+24.106529492" watchObservedRunningTime="2026-07-16 17:35:15.505793773 +0000 UTC m=+24.141995743"
Jul 16 17:35:15.556906 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.556813    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6cg2l" podStartSLOduration=7.767244203 podStartE2EDuration="23.556794702s" totalImagesPullingTime="15.789550499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:15.507506479 +0000 UTC m=+24.143708448" watchObservedRunningTime="2026-07-16 17:35:15.556794702 +0000 UTC m=+24.192996662"
Jul 16 17:35:15.557536 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.557499    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kjh44" podStartSLOduration=3.295718696 podStartE2EDuration="23.557487108s" totalImagesPullingTime="20.261768412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:15.556945464 +0000 UTC m=+24.193147414" watchObservedRunningTime="2026-07-16 17:35:15.557487108 +0000 UTC m=+24.193689075"
Jul 16 17:35:15.756803 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:15.756778    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 17:35:16.045941 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.045770    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:35:15.756800712Z","UUID":"a3309c11-1eef-4878-9476-ad684ffefec3","Handler":null,"Name":"","Endpoint":""}
Jul 16 17:35:16.047154 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.047138    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 17:35:16.047235 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.047170    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 17:35:16.187665 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.187631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:16.187852 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.187631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:16.187852 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:16.187762    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:16.187852 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.187808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:16.188061 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:16.187886    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:16.188061 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:16.187959    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:16.284072 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.284031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc" event={"ID":"e8c826b6-1c4e-4749-91b6-170866ce4918","Type":"ContainerStarted","Data":"e5caa6884ebbab8ad77e663964dea910bb20781c9c3d13cc9a735d34f292eb0a"}
Jul 16 17:35:16.285661 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.285609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7xfrf" event={"ID":"8f01a638-b7bd-47d5-801a-203607d0adc8","Type":"ContainerStarted","Data":"d32153f51d0b7adc67b77804111f5e5cd643770f31f8a25f6a7505c71d49744e"}
Jul 16 17:35:16.288687 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.288669    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:35:16.289089 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.289059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"044812010a29ba90db36fac1ed85dda4f2227526c4dfae21021fbd12e4307bc8"}
Jul 16 17:35:16.289236 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.289197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"bb6c97e264d2e85ec8a469f8032d7ae74ea8ff73d199b536f5e89df78e49713c"}
Jul 16 17:35:16.289375 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:16.289250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"b2f782b950236ce018e6a043bf348bc6ee4912263537bc6211f2aef3a78e3a9e"}
Jul 16 17:35:17.294442 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:17.294171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc" event={"ID":"e8c826b6-1c4e-4749-91b6-170866ce4918","Type":"ContainerStarted","Data":"5ad28464b0e8b2fd5299f564c255bdbeca8f83367650a63ffb4b91c21b2e95af"}
Jul 16 17:35:17.320261 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:17.320212    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7xfrf" podStartSLOduration=5.078201177 podStartE2EDuration="25.320196644s" totalImagesPullingTime="20.241995467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:16.310511124 +0000 UTC m=+24.946713096" watchObservedRunningTime="2026-07-16 17:35:17.320196644 +0000 UTC m=+25.956398611"
Jul 16 17:35:17.320435 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:17.320360    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmmmc" podStartSLOduration=2.973249678 podStartE2EDuration="25.320352019s" totalImagesPullingTime="22.347102341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:17.318656718 +0000 UTC m=+25.954858686" watchObservedRunningTime="2026-07-16 17:35:17.320352019 +0000 UTC m=+25.956553988"
Jul 16 17:35:18.187273 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:18.187239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:18.187273 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:18.187239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:18.187512 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:18.187239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:18.187512 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:18.187390    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:18.187674 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:18.187650    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:18.187776 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:18.187749    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:18.300609 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:18.300579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:35:18.301195 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:18.301015    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"7980e70e836bd19e69c2166552b41487f00fe84839b866914941c1066a1e10a0"}
Jul 16 17:35:19.405368 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:19.405327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:35:19.406139 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:19.406113    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:35:20.187709 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.187524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:20.187850 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.187524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:20.187850 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:20.187796    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:20.188085 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:20.187891    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:20.188085 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.187606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:20.188421 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:20.188402    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:20.307957 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.307886    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:35:20.308331 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.308291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"f037f3fc5a5f64392606288ee89facb980c5dca388df53197ab3b7c470e51053"}
Jul 16 17:35:20.308556 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.308539    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:35:20.308718 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.308701    2580 scope.go:117] "RemoveContainer" containerID="101e0d9d5f8818a5e2b55a4d34b412e1001a947963167d13fb99b3e87d0df096"
Jul 16 17:35:20.310190 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.310170    2580 generic.go:356] "Generic (PLEG): container finished" podID="49445d2d-147c-493c-8fcc-5fbe0687c337" containerID="a0a716932cfa60e85cc13cefc236e985c0e1c205745aeee3a1216a2d40417c0f" exitCode=0
Jul 16 17:35:20.310305 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.310261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerDied","Data":"a0a716932cfa60e85cc13cefc236e985c0e1c205745aeee3a1216a2d40417c0f"}
Jul 16 17:35:20.310490 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.310472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:35:20.311010 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.310992    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6cg2l"
Jul 16 17:35:20.324531 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:20.324512    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:35:21.315560 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:21.315537    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:35:21.316249 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:21.315915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" event={"ID":"7e0622d5-6433-4682-8ba3-df91b3f9e190","Type":"ContainerStarted","Data":"b63adfb2502fe4c321199ce118df316c8558b853388a59c7abb23b1b86c688ab"}
Jul 16 17:35:21.316249 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:21.316066    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:35:21.316249 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:21.316124    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:35:21.330820 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:21.330788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:35:21.373624 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:21.372890    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm" podStartSLOduration=8.72452562 podStartE2EDuration="29.372865253s" totalImagesPullingTime="20.648339633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:21.371423295 +0000 UTC m=+30.007625265" watchObservedRunningTime="2026-07-16 17:35:21.372865253 +0000 UTC m=+30.009067225"
Jul 16 17:35:22.188909 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.188747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:22.189082 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:22.188963    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:22.189082 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.188836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:22.189082 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:22.189034    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:22.189082 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.188809    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:22.189223 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:22.189147    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:22.194457 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.194432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7xlv6"]
Jul 16 17:35:22.197464 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.197437    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qjhmr"]
Jul 16 17:35:22.211481 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.211449    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dnnt"]
Jul 16 17:35:22.320651 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.320575    2580 generic.go:356] "Generic (PLEG): container finished" podID="49445d2d-147c-493c-8fcc-5fbe0687c337" containerID="890b559a0970571c2c70a3b3ed4bf47f9f8f4bffbaae9a48845a2cc51771ffb7" exitCode=0
Jul 16 17:35:22.321207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.320678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerDied","Data":"890b559a0970571c2c70a3b3ed4bf47f9f8f4bffbaae9a48845a2cc51771ffb7"}
Jul 16 17:35:22.321207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.320709    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:22.321207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.320692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:22.321207 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:22.320796    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:22.321207 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:22.320956    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:22.321207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:22.321199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:22.321656 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:22.321555    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:24.188090 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:24.188060    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:24.188743 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:24.188061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:24.188743 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:24.188191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:24.188743 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:24.188189    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:24.188743 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:24.188310    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:24.188743 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:24.188407    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:24.327857 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:24.327769    2580 generic.go:356] "Generic (PLEG): container finished" podID="49445d2d-147c-493c-8fcc-5fbe0687c337" containerID="f59554d1a583f7dd004d2da0f83137747200da6754a4e05d2792a0f5e0102cea" exitCode=0
Jul 16 17:35:24.327857 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:24.327806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerDied","Data":"f59554d1a583f7dd004d2da0f83137747200da6754a4e05d2792a0f5e0102cea"}
Jul 16 17:35:25.624589 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:25.624552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:25.625010 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:25.624606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:25.625010 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.624759    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:35:25.625010 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.624828    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:57.624807708 +0000 UTC m=+66.261009657 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:35:25.625010 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.624760    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:35:25.625010 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.624914    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret podName:0bda17bb-33c0-42f5-aaef-24aa7c479563 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:57.624893616 +0000 UTC m=+66.261095564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret") pod "global-pull-secret-syncer-qjhmr" (UID: "0bda17bb-33c0-42f5-aaef-24aa7c479563") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:35:25.725450 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:25.725414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:25.725651 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.725595    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:35:25.725651 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.725623    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:35:25.725651 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.725636    2580 projected.go:196] Error preparing data for projected volume kube-api-access-trtkt for pod openshift-network-diagnostics/network-check-target-7xlv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:35:25.725800 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:25.725705    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt podName:6f925e92-968e-48b4-b8b2-d377fe337bd1 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:57.725682097 +0000 UTC m=+66.361884059 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-trtkt" (UniqueName: "kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt") pod "network-check-target-7xlv6" (UID: "6f925e92-968e-48b4-b8b2-d377fe337bd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:35:26.187354 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:26.187095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:26.187560 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:26.187100    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:26.187698 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:26.187133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:26.187883 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:26.187847    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjhmr" podUID="0bda17bb-33c0-42f5-aaef-24aa7c479563"
Jul 16 17:35:26.188026 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:26.187987    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7xlv6" podUID="6f925e92-968e-48b4-b8b2-d377fe337bd1"
Jul 16 17:35:26.188120 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:26.188100    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dnnt" podUID="b2cd0c26-0ee6-4e7b-a208-397602a25675"
Jul 16 17:35:27.664266 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.664236    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-180.ec2.internal" event="NodeReady"
Jul 16 17:35:27.664725 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.664418    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 17:35:27.740577 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.740544    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mw7nr"]
Jul 16 17:35:27.778519 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.778492    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6j895"]
Jul 16 17:35:27.778688 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.778644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:27.785199 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.785179    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 17:35:27.785408 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.785267    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-27svs\""
Jul 16 17:35:27.785408 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.785181    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 17:35:27.790372 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.790345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 17:35:27.794297 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.794266    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mw7nr"]
Jul 16 17:35:27.794418 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.794396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:27.798691 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.798673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 17:35:27.798791 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.798737    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 17:35:27.798854 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.798808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t2d8t\""
Jul 16 17:35:27.808024 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.807972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6j895"]
Jul 16 17:35:27.940096 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.940018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9938b86a-7daa-49d8-b052-7d0d20ecf911-cert\") pod \"ingress-canary-mw7nr\" (UID: \"9938b86a-7daa-49d8-b052-7d0d20ecf911\") " pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:27.940096 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.940056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7prs\" (UniqueName: \"kubernetes.io/projected/9938b86a-7daa-49d8-b052-7d0d20ecf911-kube-api-access-q7prs\") pod \"ingress-canary-mw7nr\" (UID: \"9938b86a-7daa-49d8-b052-7d0d20ecf911\") " pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:27.940096 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.940081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:27.940390 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.940104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08642b6e-37f1-48e2-a82b-cb7b47fe3827-tmp-dir\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:27.940390 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.940216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08642b6e-37f1-48e2-a82b-cb7b47fe3827-config-volume\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:27.940390 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:27.940242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86dvr\" (UniqueName: \"kubernetes.io/projected/08642b6e-37f1-48e2-a82b-cb7b47fe3827-kube-api-access-86dvr\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.041024 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.040991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08642b6e-37f1-48e2-a82b-cb7b47fe3827-config-volume\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.041024 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.041038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86dvr\" (UniqueName: \"kubernetes.io/projected/08642b6e-37f1-48e2-a82b-cb7b47fe3827-kube-api-access-86dvr\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.041265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.041079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9938b86a-7daa-49d8-b052-7d0d20ecf911-cert\") pod \"ingress-canary-mw7nr\" (UID: \"9938b86a-7daa-49d8-b052-7d0d20ecf911\") " pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:28.041265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.041100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7prs\" (UniqueName: \"kubernetes.io/projected/9938b86a-7daa-49d8-b052-7d0d20ecf911-kube-api-access-q7prs\") pod \"ingress-canary-mw7nr\" (UID: \"9938b86a-7daa-49d8-b052-7d0d20ecf911\") " pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:28.041265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.041121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.041265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.041138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08642b6e-37f1-48e2-a82b-cb7b47fe3827-tmp-dir\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.041499 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.041470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08642b6e-37f1-48e2-a82b-cb7b47fe3827-tmp-dir\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.041552 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:28.041534    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:35:28.041613 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:28.041600    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls podName:08642b6e-37f1-48e2-a82b-cb7b47fe3827 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:28.541581478 +0000 UTC m=+37.177783429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls") pod "dns-default-6j895" (UID: "08642b6e-37f1-48e2-a82b-cb7b47fe3827") : secret "dns-default-metrics-tls" not found
Jul 16 17:35:28.041680 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.041623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08642b6e-37f1-48e2-a82b-cb7b47fe3827-config-volume\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.055819 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.055791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9938b86a-7daa-49d8-b052-7d0d20ecf911-cert\") pod \"ingress-canary-mw7nr\" (UID: \"9938b86a-7daa-49d8-b052-7d0d20ecf911\") " pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:28.056491 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.056457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86dvr\" (UniqueName: \"kubernetes.io/projected/08642b6e-37f1-48e2-a82b-cb7b47fe3827-kube-api-access-86dvr\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.057223 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.057202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7prs\" (UniqueName: \"kubernetes.io/projected/9938b86a-7daa-49d8-b052-7d0d20ecf911-kube-api-access-q7prs\") pod \"ingress-canary-mw7nr\" (UID: \"9938b86a-7daa-49d8-b052-7d0d20ecf911\") " pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:28.090095 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.090070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mw7nr"
Jul 16 17:35:28.190971 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.190886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:28.190971 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.190903    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:28.191189 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.191004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:28.193977 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.193939    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:35:28.193977 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.193968    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:35:28.193977 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.193972    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-28hgh\""
Jul 16 17:35:28.194245 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.194018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:35:28.194324 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.194253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4hnr\""
Jul 16 17:35:28.194383 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.194351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:35:28.507795 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.507754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mw7nr"]
Jul 16 17:35:28.546493 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:28.546469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:28.546624 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:28.546591    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:35:28.546666 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:28.546645    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls podName:08642b6e-37f1-48e2-a82b-cb7b47fe3827 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:29.546630279 +0000 UTC m=+38.182832225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls") pod "dns-default-6j895" (UID: "08642b6e-37f1-48e2-a82b-cb7b47fe3827") : secret "dns-default-metrics-tls" not found
Jul 16 17:35:28.569413 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:35:28.569387    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9938b86a_7daa_49d8_b052_7d0d20ecf911.slice/crio-26688ed55a10cc6a662edcc10f9c658a052dd73df62c650b297e71a5b5944ced WatchSource:0}: Error finding container 26688ed55a10cc6a662edcc10f9c658a052dd73df62c650b297e71a5b5944ced: Status 404 returned error can't find the container with id 26688ed55a10cc6a662edcc10f9c658a052dd73df62c650b297e71a5b5944ced
Jul 16 17:35:29.342034 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:29.341865    2580 generic.go:356] "Generic (PLEG): container finished" podID="49445d2d-147c-493c-8fcc-5fbe0687c337" containerID="7066a5b00817f0a187aeb3277ed0b8cbf41a13e9e4e4673007fc5886eaae5302" exitCode=0
Jul 16 17:35:29.342479 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:29.341941    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerDied","Data":"7066a5b00817f0a187aeb3277ed0b8cbf41a13e9e4e4673007fc5886eaae5302"}
Jul 16 17:35:29.343318 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:29.343271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mw7nr" event={"ID":"9938b86a-7daa-49d8-b052-7d0d20ecf911","Type":"ContainerStarted","Data":"26688ed55a10cc6a662edcc10f9c658a052dd73df62c650b297e71a5b5944ced"}
Jul 16 17:35:29.553248 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:29.553212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:29.553392 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:29.553371    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:35:29.553449 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:29.553439    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls podName:08642b6e-37f1-48e2-a82b-cb7b47fe3827 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:31.553423505 +0000 UTC m=+40.189625452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls") pod "dns-default-6j895" (UID: "08642b6e-37f1-48e2-a82b-cb7b47fe3827") : secret "dns-default-metrics-tls" not found
Jul 16 17:35:30.350107 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:30.350070    2580 generic.go:356] "Generic (PLEG): container finished" podID="49445d2d-147c-493c-8fcc-5fbe0687c337" containerID="da3e312a972ad7bfee45d34b7e7318c206a5cb5afb674f433196d43b48eea52a" exitCode=0
Jul 16 17:35:30.350107 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:30.350116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerDied","Data":"da3e312a972ad7bfee45d34b7e7318c206a5cb5afb674f433196d43b48eea52a"}
Jul 16 17:35:31.357624 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:31.357575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4flfv" event={"ID":"49445d2d-147c-493c-8fcc-5fbe0687c337","Type":"ContainerStarted","Data":"98ab45a5a88422d9191ceb1a7b8a80a8254b9d1923ebc5413f253b3652994c06"}
Jul 16 17:35:31.566863 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:31.566816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:31.567028 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:31.566974    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:35:31.567094 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:31.567055    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls podName:08642b6e-37f1-48e2-a82b-cb7b47fe3827 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:35.567031706 +0000 UTC m=+44.203233687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls") pod "dns-default-6j895" (UID: "08642b6e-37f1-48e2-a82b-cb7b47fe3827") : secret "dns-default-metrics-tls" not found
Jul 16 17:35:32.361648 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:32.361605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mw7nr" event={"ID":"9938b86a-7daa-49d8-b052-7d0d20ecf911","Type":"ContainerStarted","Data":"bfdd0aa76ccbcf96a44ac77714c14409d2e73b5d0080ce1fb9ccbeae56c9c99c"}
Jul 16 17:35:32.387852 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:32.387802    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mw7nr" podStartSLOduration=2.156512792 podStartE2EDuration="5.387784572s" totalImagesPullingTime="3.23127178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:32.387546972 +0000 UTC m=+41.023748939" watchObservedRunningTime="2026-07-16 17:35:32.387784572 +0000 UTC m=+41.023986541"
Jul 16 17:35:32.387991 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:32.387963    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4flfv" podStartSLOduration=8.483623879 podStartE2EDuration="40.387957388s" totalImagesPullingTime="31.904333509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:31.389327074 +0000 UTC m=+40.025529048" watchObservedRunningTime="2026-07-16 17:35:32.387957388 +0000 UTC m=+41.024159355"
Jul 16 17:35:35.595704 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:35.595671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:35.596081 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:35.595803    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:35:35.596081 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:35.595864    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls podName:08642b6e-37f1-48e2-a82b-cb7b47fe3827 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:43.595849587 +0000 UTC m=+52.232051533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls") pod "dns-default-6j895" (UID: "08642b6e-37f1-48e2-a82b-cb7b47fe3827") : secret "dns-default-metrics-tls" not found
Jul 16 17:35:43.652776 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:43.652738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:43.653198 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:43.652837    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:35:43.653198 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:43.652906    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls podName:08642b6e-37f1-48e2-a82b-cb7b47fe3827 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:59.652891291 +0000 UTC m=+68.289093237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls") pod "dns-default-6j895" (UID: "08642b6e-37f1-48e2-a82b-cb7b47fe3827") : secret "dns-default-metrics-tls" not found
Jul 16 17:35:53.332790 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:53.332760    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vqpm"
Jul 16 17:35:57.642568 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.642510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:57.642568 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.642568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:35:57.645623 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.645596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:35:57.645768 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.645749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:35:57.653719 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:57.653701    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 17:35:57.653786 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:57.653774    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs podName:b2cd0c26-0ee6-4e7b-a208-397602a25675 nodeName:}" failed. No retries permitted until 2026-07-16 17:37:01.65375274 +0000 UTC m=+130.289954686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs") pod "network-metrics-daemon-5dnnt" (UID: "b2cd0c26-0ee6-4e7b-a208-397602a25675") : secret "metrics-daemon-secret" not found
Jul 16 17:35:57.656815 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.656799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bda17bb-33c0-42f5-aaef-24aa7c479563-original-pull-secret\") pod \"global-pull-secret-syncer-qjhmr\" (UID: \"0bda17bb-33c0-42f5-aaef-24aa7c479563\") " pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:57.743860 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.743829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:57.746822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.746803    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:35:57.757138 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.757116    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:35:57.767988 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.767963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trtkt\" (UniqueName: \"kubernetes.io/projected/6f925e92-968e-48b4-b8b2-d377fe337bd1-kube-api-access-trtkt\") pod \"network-check-target-7xlv6\" (UID: \"6f925e92-968e-48b4-b8b2-d377fe337bd1\") " pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:57.912143 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.912067    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-28hgh\""
Jul 16 17:35:57.915199 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.915187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjhmr"
Jul 16 17:35:57.920092 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:57.920068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:35:58.044809 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:58.044767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qjhmr"]
Jul 16 17:35:58.047557 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:35:58.047532    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bda17bb_33c0_42f5_aaef_24aa7c479563.slice/crio-cddfb51241746940ce53b69cf1ee25796ac8cf752f6bd06056c76ebd45f51809 WatchSource:0}: Error finding container cddfb51241746940ce53b69cf1ee25796ac8cf752f6bd06056c76ebd45f51809: Status 404 returned error can't find the container with id cddfb51241746940ce53b69cf1ee25796ac8cf752f6bd06056c76ebd45f51809
Jul 16 17:35:58.061944 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:58.061921    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7xlv6"]
Jul 16 17:35:58.064754 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:35:58.064732    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f925e92_968e_48b4_b8b2_d377fe337bd1.slice/crio-a51546f03beee335e118a54d66dc169afb170d78be269b23c17cdcef5c22fcf4 WatchSource:0}: Error finding container a51546f03beee335e118a54d66dc169afb170d78be269b23c17cdcef5c22fcf4: Status 404 returned error can't find the container with id a51546f03beee335e118a54d66dc169afb170d78be269b23c17cdcef5c22fcf4
Jul 16 17:35:58.423757 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:58.423710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7xlv6" event={"ID":"6f925e92-968e-48b4-b8b2-d377fe337bd1","Type":"ContainerStarted","Data":"a51546f03beee335e118a54d66dc169afb170d78be269b23c17cdcef5c22fcf4"}
Jul 16 17:35:58.425435 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:58.425404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qjhmr" event={"ID":"0bda17bb-33c0-42f5-aaef-24aa7c479563","Type":"ContainerStarted","Data":"cddfb51241746940ce53b69cf1ee25796ac8cf752f6bd06056c76ebd45f51809"}
Jul 16 17:35:59.656991 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:35:59.656951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:35:59.657482 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:59.657132    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:35:59.657482 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:35:59.657215    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls podName:08642b6e-37f1-48e2-a82b-cb7b47fe3827 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:31.657193691 +0000 UTC m=+100.293395660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls") pod "dns-default-6j895" (UID: "08642b6e-37f1-48e2-a82b-cb7b47fe3827") : secret "dns-default-metrics-tls" not found
Jul 16 17:36:00.923692 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.923658    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-nkbnv"]
Jul 16 17:36:00.925377 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.925356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:00.932989 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.932962    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 17:36:00.932989 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.932977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 17:36:00.933863 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.933843    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 17:36:00.933968 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.933846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pqv44\""
Jul 16 17:36:00.933968 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.933928    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:36:00.942790 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.942769    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 17:36:00.959767 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.959743    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-nkbnv"]
Jul 16 17:36:00.968034 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.968006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-config\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:00.968142 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.968051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf9xd\" (UniqueName: \"kubernetes.io/projected/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-kube-api-access-rf9xd\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:00.968200 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.968153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-serving-cert\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:00.968200 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:00.968192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-trusted-ca\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.068977 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.068938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-serving-cert\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.068977 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.068983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-trusted-ca\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.069212 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.069036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-config\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.069212 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.069062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9xd\" (UniqueName: \"kubernetes.io/projected/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-kube-api-access-rf9xd\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.069902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.069857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-config\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.070021 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.069972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-trusted-ca\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.071661 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.071636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-serving-cert\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.076597 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.076577    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"]
Jul 16 17:36:01.078814 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.078793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.081895 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.081878    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 16 17:36:01.082994 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.082973    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:36:01.083735 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.083707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 16 17:36:01.087800 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.087780    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mx4q8\""
Jul 16 17:36:01.090675 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.090656    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 16 17:36:01.091205 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.091188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf9xd\" (UniqueName: \"kubernetes.io/projected/a5cd749a-2e5b-44fd-9a81-441a951f9ee7-kube-api-access-rf9xd\") pod \"console-operator-7866497494-nkbnv\" (UID: \"a5cd749a-2e5b-44fd-9a81-441a951f9ee7\") " pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.100580 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.100560    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"]
Jul 16 17:36:01.102263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.102248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:01.104892 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:01.104858    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret"
Jul 16 17:36:01.105345 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:01.105316    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-l9dlk\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l9dlk\"" type="*v1.Secret"
Jul 16 17:36:01.105784 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:01.105740    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 16 17:36:01.105878 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:01.105806    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap"
Jul 16 17:36:01.105878 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:01.105845    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 16 17:36:01.115532 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.115502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"]
Jul 16 17:36:01.167820 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.167779    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"]
Jul 16 17:36:01.169772 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.169747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5306ef8d-66c7-41d6-a93b-7948ad43ade2-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.169902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.169791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5306ef8d-66c7-41d6-a93b-7948ad43ade2-config\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.169902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.169824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqdng\" (UniqueName: \"kubernetes.io/projected/5306ef8d-66c7-41d6-a93b-7948ad43ade2-kube-api-access-hqdng\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.169902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.169853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fea963ca-8f54-4efb-ac8d-e68a31099d96-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:01.169902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.169886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fea963ca-8f54-4efb-ac8d-e68a31099d96-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:01.170113 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.169938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85ttn\" (UniqueName: \"kubernetes.io/projected/fea963ca-8f54-4efb-ac8d-e68a31099d96-kube-api-access-85ttn\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:01.235548 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.235469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:01.270640 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.270611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5306ef8d-66c7-41d6-a93b-7948ad43ade2-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.270796 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.270648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5306ef8d-66c7-41d6-a93b-7948ad43ade2-config\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.270796 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.270676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqdng\" (UniqueName: \"kubernetes.io/projected/5306ef8d-66c7-41d6-a93b-7948ad43ade2-kube-api-access-hqdng\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.270796 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.270698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fea963ca-8f54-4efb-ac8d-e68a31099d96-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:01.270796 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.270725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fea963ca-8f54-4efb-ac8d-e68a31099d96-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:01.270796 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.270770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85ttn\" (UniqueName: \"kubernetes.io/projected/fea963ca-8f54-4efb-ac8d-e68a31099d96-kube-api-access-85ttn\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:01.271275 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.271253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5306ef8d-66c7-41d6-a93b-7948ad43ade2-config\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.273258 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.273225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5306ef8d-66c7-41d6-a93b-7948ad43ade2-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.290242 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.290216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqdng\" (UniqueName: \"kubernetes.io/projected/5306ef8d-66c7-41d6-a93b-7948ad43ade2-kube-api-access-hqdng\") pod \"service-ca-operator-7695fc6c8c-l9v9d\" (UID: \"5306ef8d-66c7-41d6-a93b-7948ad43ade2\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.388804 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.388764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"
Jul 16 17:36:01.975038 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:01.975010    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:36:02.059708 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.059679    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 16 17:36:02.064034 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.064006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fea963ca-8f54-4efb-ac8d-e68a31099d96-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:02.154978 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.154953    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l9dlk\""
Jul 16 17:36:02.271944 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:02.271856    2580 configmap.go:193] Couldn't get configMap openshift-kube-storage-version-migrator-operator/config: failed to sync configmap cache: timed out waiting for the condition
Jul 16 17:36:02.272104 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:02.271979    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fea963ca-8f54-4efb-ac8d-e68a31099d96-config podName:fea963ca-8f54-4efb-ac8d-e68a31099d96 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:02.771953386 +0000 UTC m=+71.408155356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/fea963ca-8f54-4efb-ac8d-e68a31099d96-config") pod "kube-storage-version-migrator-operator-799cb7f958-lk6hb" (UID: "fea963ca-8f54-4efb-ac8d-e68a31099d96") : failed to sync configmap cache: timed out waiting for the condition
Jul 16 17:36:02.287372 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:02.287347    2580 projected.go:291] Couldn't get configMap openshift-kube-storage-version-migrator-operator/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 16 17:36:02.287372 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:02.287382    2580 projected.go:196] Error preparing data for projected volume kube-api-access-85ttn for pod openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb: failed to sync configmap cache: timed out waiting for the condition
Jul 16 17:36:02.287547 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:02.287434    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fea963ca-8f54-4efb-ac8d-e68a31099d96-kube-api-access-85ttn podName:fea963ca-8f54-4efb-ac8d-e68a31099d96 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:02.78742011 +0000 UTC m=+71.423622056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-85ttn" (UniqueName: "kubernetes.io/projected/fea963ca-8f54-4efb-ac8d-e68a31099d96-kube-api-access-85ttn") pod "kube-storage-version-migrator-operator-799cb7f958-lk6hb" (UID: "fea963ca-8f54-4efb-ac8d-e68a31099d96") : failed to sync configmap cache: timed out waiting for the condition
Jul 16 17:36:02.307725 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.307699    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 16 17:36:02.444461 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.444397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7xlv6" event={"ID":"6f925e92-968e-48b4-b8b2-d377fe337bd1","Type":"ContainerStarted","Data":"0b250035d8d456a23d3c01007b35d63b8ee6ddbae01d299ebac731747fdd07af"}
Jul 16 17:36:02.444580 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.444505    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:36:02.508971 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.508911    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7xlv6" podStartSLOduration=66.233687926 podStartE2EDuration="1m10.508886124s" totalImagesPullingTime="4.275198198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:02.468683188 +0000 UTC m=+71.104885157" watchObservedRunningTime="2026-07-16 17:36:02.508886124 +0000 UTC m=+71.145088092"
Jul 16 17:36:02.512059 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.511174    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d"]
Jul 16 17:36:02.512059 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.511232    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-nkbnv"]
Jul 16 17:36:02.513339 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:02.513307    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5306ef8d_66c7_41d6_a93b_7948ad43ade2.slice/crio-92d6cb107f767ce19993f0eba1b64eb054951b10fa261d961f52a61f18ac91e4 WatchSource:0}: Error finding container 92d6cb107f767ce19993f0eba1b64eb054951b10fa261d961f52a61f18ac91e4: Status 404 returned error can't find the container with id 92d6cb107f767ce19993f0eba1b64eb054951b10fa261d961f52a61f18ac91e4
Jul 16 17:36:02.514131 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:02.514108    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cd749a_2e5b_44fd_9a81_441a951f9ee7.slice/crio-6ad5f95c6f9c6b75c659aa790c2f673f056ab99adf201061bf090434b2b96355 WatchSource:0}: Error finding container 6ad5f95c6f9c6b75c659aa790c2f673f056ab99adf201061bf090434b2b96355: Status 404 returned error can't find the container with id 6ad5f95c6f9c6b75c659aa790c2f673f056ab99adf201061bf090434b2b96355
Jul 16 17:36:02.605078 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.604988    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 16 17:36:02.785622 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.785590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fea963ca-8f54-4efb-ac8d-e68a31099d96-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:02.786110 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.786087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fea963ca-8f54-4efb-ac8d-e68a31099d96-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:02.886488 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.886459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85ttn\" (UniqueName: \"kubernetes.io/projected/fea963ca-8f54-4efb-ac8d-e68a31099d96-kube-api-access-85ttn\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:02.888770 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.888750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85ttn\" (UniqueName: \"kubernetes.io/projected/fea963ca-8f54-4efb-ac8d-e68a31099d96-kube-api-access-85ttn\") pod \"kube-storage-version-migrator-operator-799cb7f958-lk6hb\" (UID: \"fea963ca-8f54-4efb-ac8d-e68a31099d96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:02.911812 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:02.911791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"
Jul 16 17:36:03.039315 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:03.039264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb"]
Jul 16 17:36:03.042765 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:03.042743    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea963ca_8f54_4efb_ac8d_e68a31099d96.slice/crio-5e067bcd82a1c74bfd906e292f21238eb67f8bf4c4db1a998ba3a5c9a4ff8936 WatchSource:0}: Error finding container 5e067bcd82a1c74bfd906e292f21238eb67f8bf4c4db1a998ba3a5c9a4ff8936: Status 404 returned error can't find the container with id 5e067bcd82a1c74bfd906e292f21238eb67f8bf4c4db1a998ba3a5c9a4ff8936
Jul 16 17:36:03.448202 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:03.448162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d" event={"ID":"5306ef8d-66c7-41d6-a93b-7948ad43ade2","Type":"ContainerStarted","Data":"92d6cb107f767ce19993f0eba1b64eb054951b10fa261d961f52a61f18ac91e4"}
Jul 16 17:36:03.449744 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:03.449711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qjhmr" event={"ID":"0bda17bb-33c0-42f5-aaef-24aa7c479563","Type":"ContainerStarted","Data":"42ca3ab1dec717a465e0a53901ae32991916cb62d9dddc608f4d8080616aa7d0"}
Jul 16 17:36:03.451005 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:03.450978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nkbnv" event={"ID":"a5cd749a-2e5b-44fd-9a81-441a951f9ee7","Type":"ContainerStarted","Data":"6ad5f95c6f9c6b75c659aa790c2f673f056ab99adf201061bf090434b2b96355"}
Jul 16 17:36:03.452160 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:03.452135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb" event={"ID":"fea963ca-8f54-4efb-ac8d-e68a31099d96","Type":"ContainerStarted","Data":"5e067bcd82a1c74bfd906e292f21238eb67f8bf4c4db1a998ba3a5c9a4ff8936"}
Jul 16 17:36:03.472510 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:03.472454    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qjhmr" podStartSLOduration=67.172242287 podStartE2EDuration="1m11.472438023s" totalImagesPullingTime="4.300195736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:03.472356158 +0000 UTC m=+72.108558125" watchObservedRunningTime="2026-07-16 17:36:03.472438023 +0000 UTC m=+72.108640058"
Jul 16 17:36:05.007742 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.007709    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ftsqx"]
Jul 16 17:36:05.010056 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.010038    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.012723 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.012700    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 17:36:05.012920 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.012894    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wnl5b\""
Jul 16 17:36:05.013003 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.012932    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 17:36:05.013884 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.013866    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 17:36:05.013999 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.013908    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 17:36:05.027605 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.027584    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ftsqx"]
Jul 16 17:36:05.103924 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.103892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.104118 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.103941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzvp\" (UniqueName: \"kubernetes.io/projected/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-api-access-tmzvp\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.104118 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.103971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8fc36cf8-8882-48a3-b22a-4b671cab7694-crio-socket\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.104118 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.104058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.104308 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.104136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fc36cf8-8882-48a3-b22a-4b671cab7694-data-volume\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.205102 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.205065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.205304 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.205117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fc36cf8-8882-48a3-b22a-4b671cab7694-data-volume\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.205304 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.205176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.205304 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.205216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzvp\" (UniqueName: \"kubernetes.io/projected/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-api-access-tmzvp\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.205304 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.205244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8fc36cf8-8882-48a3-b22a-4b671cab7694-crio-socket\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.205304 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.205262    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:05.205512 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.205306    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:36:05.205512 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.205346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8fc36cf8-8882-48a3-b22a-4b671cab7694-crio-socket\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.205512 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.205358    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:05.705337651 +0000 UTC m=+74.341539612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:05.205512 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.205380    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:05.705368546 +0000 UTC m=+74.341570506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : configmap "kube-rbac-proxy" not found
Jul 16 17:36:05.205686 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.205549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fc36cf8-8882-48a3-b22a-4b671cab7694-data-volume\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.216034 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.216004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzvp\" (UniqueName: \"kubernetes.io/projected/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-api-access-tmzvp\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.709781 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.709741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.709971 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:05.709841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:05.709971 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.709928    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:05.709971 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.709963    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:36:05.710116 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.710016    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:06.709995006 +0000 UTC m=+75.346196954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:05.710116 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:05.710042    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:06.710031767 +0000 UTC m=+75.346233716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : configmap "kube-rbac-proxy" not found
Jul 16 17:36:06.463318 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.463263    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/0.log"
Jul 16 17:36:06.463781 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.463332    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5cd749a-2e5b-44fd-9a81-441a951f9ee7" containerID="7d2928fcb7b09e64ab6a619c6ae732b8b312afa79d2e4206fec759ec814bbb5e" exitCode=255
Jul 16 17:36:06.463781 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.463423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nkbnv" event={"ID":"a5cd749a-2e5b-44fd-9a81-441a951f9ee7","Type":"ContainerDied","Data":"7d2928fcb7b09e64ab6a619c6ae732b8b312afa79d2e4206fec759ec814bbb5e"}
Jul 16 17:36:06.463781 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.463649    2580 scope.go:117] "RemoveContainer" containerID="7d2928fcb7b09e64ab6a619c6ae732b8b312afa79d2e4206fec759ec814bbb5e"
Jul 16 17:36:06.464935 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.464905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb" event={"ID":"fea963ca-8f54-4efb-ac8d-e68a31099d96","Type":"ContainerStarted","Data":"44eb5e7bd68f43c385cc39e198b5cc924db4e70813ef82add9369d2742ac4f6d"}
Jul 16 17:36:06.466385 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.466365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d" event={"ID":"5306ef8d-66c7-41d6-a93b-7948ad43ade2","Type":"ContainerStarted","Data":"6c298804a47f1782fd10e9060e3cbf79d8dd2f5897e00d2e65e1141ce58c33c1"}
Jul 16 17:36:06.504706 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.504658    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb" podStartSLOduration=2.731117015 podStartE2EDuration="5.504636989s" totalImagesPullingTime="2.773519974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:06.503881393 +0000 UTC m=+75.140083359" watchObservedRunningTime="2026-07-16 17:36:06.504636989 +0000 UTC m=+75.140838958"
Jul 16 17:36:06.521786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.521742    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d" podStartSLOduration=2.219146024 podStartE2EDuration="5.521725525s" totalImagesPullingTime="3.302579501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:06.520985194 +0000 UTC m=+75.157187163" watchObservedRunningTime="2026-07-16 17:36:06.521725525 +0000 UTC m=+75.157927493"
Jul 16 17:36:06.717838 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.717763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:06.717838 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:06.717812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:06.718045 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:06.717891    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:36:06.718045 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:06.717934    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:06.718045 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:06.717950    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:08.717935179 +0000 UTC m=+77.354137127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : configmap "kube-rbac-proxy" not found
Jul 16 17:36:06.718045 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:06.717996    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:08.717979665 +0000 UTC m=+77.354181628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:07.009415 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.009332    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xkbj_b1b04fd5-0f3c-4280-bbe6-21eaa8f37067/dns-node-resolver/0.log"
Jul 16 17:36:07.471800 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.471771    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:36:07.472223 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.472176    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/0.log"
Jul 16 17:36:07.472223 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.472208    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5cd749a-2e5b-44fd-9a81-441a951f9ee7" containerID="f7c979278a962ae8bb2341b2531b645dc299eada5175278bb4e4221fecc19753" exitCode=255
Jul 16 17:36:07.472343 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.472311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nkbnv" event={"ID":"a5cd749a-2e5b-44fd-9a81-441a951f9ee7","Type":"ContainerDied","Data":"f7c979278a962ae8bb2341b2531b645dc299eada5175278bb4e4221fecc19753"}
Jul 16 17:36:07.472387 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.472375    2580 scope.go:117] "RemoveContainer" containerID="7d2928fcb7b09e64ab6a619c6ae732b8b312afa79d2e4206fec759ec814bbb5e"
Jul 16 17:36:07.472517 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.472502    2580 scope.go:117] "RemoveContainer" containerID="f7c979278a962ae8bb2341b2531b645dc299eada5175278bb4e4221fecc19753"
Jul 16 17:36:07.472682 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:07.472659    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nkbnv_openshift-console-operator(a5cd749a-2e5b-44fd-9a81-441a951f9ee7)\"" pod="openshift-console-operator/console-operator-7866497494-nkbnv" podUID="a5cd749a-2e5b-44fd-9a81-441a951f9ee7"
Jul 16 17:36:07.609045 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:07.609022    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f4wxn_2a4d2858-5981-43ea-bffa-97593ee9622d/node-ca/0.log"
Jul 16 17:36:08.336027 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.335996    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"]
Jul 16 17:36:08.340646 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.340622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"
Jul 16 17:36:08.346165 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.346135    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-m9txw\""
Jul 16 17:36:08.346665 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.346643    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 17:36:08.347387 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.347366    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 17:36:08.365703 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.365677    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"]
Jul 16 17:36:08.433792 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.433756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wdjc\" (UniqueName: \"kubernetes.io/projected/37e477e7-402f-44f7-b221-1293c68c88f1-kube-api-access-8wdjc\") pod \"migrator-7f59b54f6c-5fthk\" (UID: \"37e477e7-402f-44f7-b221-1293c68c88f1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"
Jul 16 17:36:08.476441 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.476418    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:36:08.476768 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.476748    2580 scope.go:117] "RemoveContainer" containerID="f7c979278a962ae8bb2341b2531b645dc299eada5175278bb4e4221fecc19753"
Jul 16 17:36:08.476920 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:08.476900    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nkbnv_openshift-console-operator(a5cd749a-2e5b-44fd-9a81-441a951f9ee7)\"" pod="openshift-console-operator/console-operator-7866497494-nkbnv" podUID="a5cd749a-2e5b-44fd-9a81-441a951f9ee7"
Jul 16 17:36:08.534421 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.534391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wdjc\" (UniqueName: \"kubernetes.io/projected/37e477e7-402f-44f7-b221-1293c68c88f1-kube-api-access-8wdjc\") pod \"migrator-7f59b54f6c-5fthk\" (UID: \"37e477e7-402f-44f7-b221-1293c68c88f1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"
Jul 16 17:36:08.548461 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.548438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wdjc\" (UniqueName: \"kubernetes.io/projected/37e477e7-402f-44f7-b221-1293c68c88f1-kube-api-access-8wdjc\") pod \"migrator-7f59b54f6c-5fthk\" (UID: \"37e477e7-402f-44f7-b221-1293c68c88f1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"
Jul 16 17:36:08.650203 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.650176    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"
Jul 16 17:36:08.735776 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.735750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:08.735898 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.735807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:08.735956 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:08.735897    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:36:08.735988 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:08.735909    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:08.736026 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:08.735990    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:12.73596728 +0000 UTC m=+81.372169241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : configmap "kube-rbac-proxy" not found
Jul 16 17:36:08.736026 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:08.736021    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:12.736008574 +0000 UTC m=+81.372210521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:08.784963 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.784932    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk"]
Jul 16 17:36:08.789034 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:08.789003    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e477e7_402f_44f7_b221_1293c68c88f1.slice/crio-fc3818f8396713b79475ae3009ec06b8615aa20055ddccfc10db8857a81d47ef WatchSource:0}: Error finding container fc3818f8396713b79475ae3009ec06b8615aa20055ddccfc10db8857a81d47ef: Status 404 returned error can't find the container with id fc3818f8396713b79475ae3009ec06b8615aa20055ddccfc10db8857a81d47ef
Jul 16 17:36:08.808474 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:08.808451    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mw7nr_9938b86a-7daa-49d8-b052-7d0d20ecf911/serve-healthcheck-canary/0.log"
Jul 16 17:36:09.481076 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.481042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk" event={"ID":"37e477e7-402f-44f7-b221-1293c68c88f1","Type":"ContainerStarted","Data":"fc3818f8396713b79475ae3009ec06b8615aa20055ddccfc10db8857a81d47ef"}
Jul 16 17:36:09.830178 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.830100    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-xm4rd"]
Jul 16 17:36:09.834533 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.834511    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:09.837420 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.837402    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 17:36:09.837521 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.837431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 17:36:09.838298 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.838265    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 17:36:09.838408 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.838268    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-c9fws\""
Jul 16 17:36:09.838408 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.838347    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 17:36:09.844057 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.844032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-xm4rd"]
Jul 16 17:36:09.945050 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.945021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4230cb0d-fec5-4008-acb6-34b218d63213-signing-cabundle\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:09.945228 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.945085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4230cb0d-fec5-4008-acb6-34b218d63213-signing-key\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:09.945228 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:09.945113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dht5l\" (UniqueName: \"kubernetes.io/projected/4230cb0d-fec5-4008-acb6-34b218d63213-kube-api-access-dht5l\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.046430 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.046396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4230cb0d-fec5-4008-acb6-34b218d63213-signing-cabundle\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.046583 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.046462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4230cb0d-fec5-4008-acb6-34b218d63213-signing-key\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.046583 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.046481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dht5l\" (UniqueName: \"kubernetes.io/projected/4230cb0d-fec5-4008-acb6-34b218d63213-kube-api-access-dht5l\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.047075 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.047048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4230cb0d-fec5-4008-acb6-34b218d63213-signing-cabundle\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.048800 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.048780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4230cb0d-fec5-4008-acb6-34b218d63213-signing-key\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.056852 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.056827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dht5l\" (UniqueName: \"kubernetes.io/projected/4230cb0d-fec5-4008-acb6-34b218d63213-kube-api-access-dht5l\") pod \"service-ca-79f68b9f4f-xm4rd\" (UID: \"4230cb0d-fec5-4008-acb6-34b218d63213\") " pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.144137 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.144102    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd"
Jul 16 17:36:10.277508 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.277474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-xm4rd"]
Jul 16 17:36:10.281049 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:10.281020    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4230cb0d_fec5_4008_acb6_34b218d63213.slice/crio-2eed2f9e9d246b5a50e5aef0df45a2f8278314a39290220824534b65e1601204 WatchSource:0}: Error finding container 2eed2f9e9d246b5a50e5aef0df45a2f8278314a39290220824534b65e1601204: Status 404 returned error can't find the container with id 2eed2f9e9d246b5a50e5aef0df45a2f8278314a39290220824534b65e1601204
Jul 16 17:36:10.488266 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.488185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd" event={"ID":"4230cb0d-fec5-4008-acb6-34b218d63213","Type":"ContainerStarted","Data":"ce24a8adce50c737156bb3769a1ad79471e599b96be98a05363a1d68501a8255"}
Jul 16 17:36:10.488266 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.488240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd" event={"ID":"4230cb0d-fec5-4008-acb6-34b218d63213","Type":"ContainerStarted","Data":"2eed2f9e9d246b5a50e5aef0df45a2f8278314a39290220824534b65e1601204"}
Jul 16 17:36:10.506375 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:10.506315    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-xm4rd" podStartSLOduration=1.506295454 podStartE2EDuration="1.506295454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:10.505740873 +0000 UTC m=+79.141942842" watchObservedRunningTime="2026-07-16 17:36:10.506295454 +0000 UTC m=+79.142497415"
Jul 16 17:36:11.235995 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:11.235947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:11.236166 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:11.236022    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:11.236468 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:11.236454    2580 scope.go:117] "RemoveContainer" containerID="f7c979278a962ae8bb2341b2531b645dc299eada5175278bb4e4221fecc19753"
Jul 16 17:36:11.236658 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:11.236636    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-nkbnv_openshift-console-operator(a5cd749a-2e5b-44fd-9a81-441a951f9ee7)\"" pod="openshift-console-operator/console-operator-7866497494-nkbnv" podUID="a5cd749a-2e5b-44fd-9a81-441a951f9ee7"
Jul 16 17:36:11.494012 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:11.493923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk" event={"ID":"37e477e7-402f-44f7-b221-1293c68c88f1","Type":"ContainerStarted","Data":"dbd0e8afabe7153fc625f2f45086e2c411b3e76a4108336a24e92b3dd4dddeb7"}
Jul 16 17:36:11.494012 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:11.493974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk" event={"ID":"37e477e7-402f-44f7-b221-1293c68c88f1","Type":"ContainerStarted","Data":"7a4ebdb07231f736094b2e2cb3df3028274361f04e1f60b9da2fe373cc6ae61a"}
Jul 16 17:36:11.515237 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:11.515181    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5fthk" podStartSLOduration=1.7156341830000001 podStartE2EDuration="3.515160725s" totalImagesPullingTime="1.799526542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:11.51451561 +0000 UTC m=+80.150717578" watchObservedRunningTime="2026-07-16 17:36:11.515160725 +0000 UTC m=+80.151362694"
Jul 16 17:36:12.773292 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:12.773235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:12.773667 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:12.773343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:12.773667 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:12.773417    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:12.773667 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:12.773440    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:36:12.773667 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:12.773496    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:20.773478245 +0000 UTC m=+89.409680194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : configmap "kube-rbac-proxy" not found
Jul 16 17:36:12.773667 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:12.773513    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:20.773503774 +0000 UTC m=+89.409705723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:20.836742 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:20.836597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:20.836742 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:20.836674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:20.837428 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:20.836785    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:20.837428 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:20.836873    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls podName:8fc36cf8-8882-48a3-b22a-4b671cab7694 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:36.836850905 +0000 UTC m=+105.473052865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ftsqx" (UID: "8fc36cf8-8882-48a3-b22a-4b671cab7694") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:36:20.837428 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:20.837322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc36cf8-8882-48a3-b22a-4b671cab7694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:24.188097 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:24.188063    2580 scope.go:117] "RemoveContainer" containerID="f7c979278a962ae8bb2341b2531b645dc299eada5175278bb4e4221fecc19753"
Jul 16 17:36:24.535662 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:24.535585    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:36:24.535801 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:24.535658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-nkbnv" event={"ID":"a5cd749a-2e5b-44fd-9a81-441a951f9ee7","Type":"ContainerStarted","Data":"f1975bac1d5b8a171f62b48781840d63cd432b1e6a4e4e87995df63fc1de73d6"}
Jul 16 17:36:24.535949 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:24.535929    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:24.555826 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:24.555768    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-nkbnv" podStartSLOduration=21.248651253 podStartE2EDuration="24.55574868s" totalImagesPullingTime="3.307097427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:24.554861703 +0000 UTC m=+93.191063670" watchObservedRunningTime="2026-07-16 17:36:24.55574868 +0000 UTC m=+93.191950648"
Jul 16 17:36:24.644761 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:24.644732    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-nkbnv"
Jul 16 17:36:31.259953 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.259919    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"]
Jul 16 17:36:31.263297 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.263267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.274831 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.274810    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 17:36:31.274957 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.274931    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 17:36:31.275040 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.275025    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 17:36:31.278750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.278730    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bfrkn\""
Jul 16 17:36:31.284291 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.284258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 17:36:31.286731 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.286710    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"]
Jul 16 17:36:31.316372 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.316338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01d88f10-8c03-41af-9f64-4ef370ce0507-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87bf4b746-7tgv6\" (UID: \"01d88f10-8c03-41af-9f64-4ef370ce0507\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.316550 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.316448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l6lh\" (UniqueName: \"kubernetes.io/projected/01d88f10-8c03-41af-9f64-4ef370ce0507-kube-api-access-9l6lh\") pod \"managed-serviceaccount-addon-agent-87bf4b746-7tgv6\" (UID: \"01d88f10-8c03-41af-9f64-4ef370ce0507\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.375012 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.374978    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66695db459-q5zrn"]
Jul 16 17:36:31.377974 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.377956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.385194 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.385170    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-d57tx"]
Jul 16 17:36:31.388177 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.388153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:31.392055 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:31.392023    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-66695db459-q5zrn\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" podUID="c9e4b590-c5f8-4277-b6fe-6109f7287710" pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.392166 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:31.392115    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret"
Jul 16 17:36:31.392166 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:31.392125    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-wsnnh\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsnnh\"" type="*v1.Secret"
Jul 16 17:36:31.395914 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:31.395879    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"networking-console-plugin-cert\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-console\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret"
Jul 16 17:36:31.396017 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.395974    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 17:36:31.396017 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.395988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 17:36:31.396173 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:31.396151    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"networking-console-plugin\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-network-console\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap"
Jul 16 17:36:31.396235 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:31.396214    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-tdh8m\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-console\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tdh8m\"" type="*v1.Secret"
Jul 16 17:36:31.403235 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.403218    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 17:36:31.409972 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.409942    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-d57tx"]
Jul 16 17:36:31.413060 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.413031    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66695db459-q5zrn"]
Jul 16 17:36:31.417868 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.417838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01d88f10-8c03-41af-9f64-4ef370ce0507-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87bf4b746-7tgv6\" (UID: \"01d88f10-8c03-41af-9f64-4ef370ce0507\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.417990 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.417911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l6lh\" (UniqueName: \"kubernetes.io/projected/01d88f10-8c03-41af-9f64-4ef370ce0507-kube-api-access-9l6lh\") pod \"managed-serviceaccount-addon-agent-87bf4b746-7tgv6\" (UID: \"01d88f10-8c03-41af-9f64-4ef370ce0507\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.420619 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.420593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01d88f10-8c03-41af-9f64-4ef370ce0507-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87bf4b746-7tgv6\" (UID: \"01d88f10-8c03-41af-9f64-4ef370ce0507\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.442984 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.442961    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-7jpdn"]
Jul 16 17:36:31.446129 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.446113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-7jpdn"
Jul 16 17:36:31.450674 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.450653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l6lh\" (UniqueName: \"kubernetes.io/projected/01d88f10-8c03-41af-9f64-4ef370ce0507-kube-api-access-9l6lh\") pod \"managed-serviceaccount-addon-agent-87bf4b746-7tgv6\" (UID: \"01d88f10-8c03-41af-9f64-4ef370ce0507\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.451625 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.451597    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 17:36:31.454428 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.454410    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 17:36:31.459603 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.459586    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cgrtt\""
Jul 16 17:36:31.474378 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.474347    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-7jpdn"]
Jul 16 17:36:31.519163 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-registry-tls\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.519163 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ed2a920-8597-4db3-90ed-efb54db7aa39-nginx-conf\") pod \"networking-console-plugin-6cf856758c-d57tx\" (UID: \"8ed2a920-8597-4db3-90ed-efb54db7aa39\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:31.519163 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-image-registry-private-configuration\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.519407 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9e4b590-c5f8-4277-b6fe-6109f7287710-trusted-ca\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.519407 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ed2a920-8597-4db3-90ed-efb54db7aa39-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-d57tx\" (UID: \"8ed2a920-8597-4db3-90ed-efb54db7aa39\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:31.519407 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5vg2\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-kube-api-access-h5vg2\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.519407 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9e4b590-c5f8-4277-b6fe-6109f7287710-registry-certificates\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.519407 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9e4b590-c5f8-4277-b6fe-6109f7287710-ca-trust-extracted\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.519586 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-bound-sa-token\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.519586 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8v9k\" (UniqueName: \"kubernetes.io/projected/edfb7ce2-b7ee-4d33-a11f-2de7432de33a-kube-api-access-w8v9k\") pod \"downloads-68c9cbb497-7jpdn\" (UID: \"edfb7ce2-b7ee-4d33-a11f-2de7432de33a\") " pod="openshift-console/downloads-68c9cbb497-7jpdn"
Jul 16 17:36:31.519586 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.519487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-installation-pull-secrets\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.588724 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.588687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"
Jul 16 17:36:31.620867 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.620835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9e4b590-c5f8-4277-b6fe-6109f7287710-ca-trust-extracted\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621070 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.620873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-bound-sa-token\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621070 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.620908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8v9k\" (UniqueName: \"kubernetes.io/projected/edfb7ce2-b7ee-4d33-a11f-2de7432de33a-kube-api-access-w8v9k\") pod \"downloads-68c9cbb497-7jpdn\" (UID: \"edfb7ce2-b7ee-4d33-a11f-2de7432de33a\") " pod="openshift-console/downloads-68c9cbb497-7jpdn"
Jul 16 17:36:31.621194 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-installation-pull-secrets\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621513 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9e4b590-c5f8-4277-b6fe-6109f7287710-ca-trust-extracted\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621622 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-registry-tls\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621622 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ed2a920-8597-4db3-90ed-efb54db7aa39-nginx-conf\") pod \"networking-console-plugin-6cf856758c-d57tx\" (UID: \"8ed2a920-8597-4db3-90ed-efb54db7aa39\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:31.621728 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-image-registry-private-configuration\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621780 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9e4b590-c5f8-4277-b6fe-6109f7287710-trusted-ca\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621837 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ed2a920-8597-4db3-90ed-efb54db7aa39-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-d57tx\" (UID: \"8ed2a920-8597-4db3-90ed-efb54db7aa39\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:31.621837 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5vg2\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-kube-api-access-h5vg2\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.621937 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.621866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9e4b590-c5f8-4277-b6fe-6109f7287710-registry-certificates\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.622765 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.622739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9e4b590-c5f8-4277-b6fe-6109f7287710-registry-certificates\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.623142 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.623119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9e4b590-c5f8-4277-b6fe-6109f7287710-trusted-ca\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.624015 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.623993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-installation-pull-secrets\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.624596 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.624574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-registry-tls\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.655494 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.655464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-bound-sa-token\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.655684 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.655661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8v9k\" (UniqueName: \"kubernetes.io/projected/edfb7ce2-b7ee-4d33-a11f-2de7432de33a-kube-api-access-w8v9k\") pod \"downloads-68c9cbb497-7jpdn\" (UID: \"edfb7ce2-b7ee-4d33-a11f-2de7432de33a\") " pod="openshift-console/downloads-68c9cbb497-7jpdn"
Jul 16 17:36:31.655747 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.655664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5vg2\" (UniqueName: \"kubernetes.io/projected/c9e4b590-c5f8-4277-b6fe-6109f7287710-kube-api-access-h5vg2\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:31.722679 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.722643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:36:31.724899 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.724870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08642b6e-37f1-48e2-a82b-cb7b47fe3827-metrics-tls\") pod \"dns-default-6j895\" (UID: \"08642b6e-37f1-48e2-a82b-cb7b47fe3827\") " pod="openshift-dns/dns-default-6j895"
Jul 16 17:36:31.730785 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.730758    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6"]
Jul 16 17:36:31.733345 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:31.733263    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01d88f10_8c03_41af_9f64_4ef370ce0507.slice/crio-f890afa073b60fd219430eb2193b82638de8c414558c98a8c638cd9ca1ca59bd WatchSource:0}: Error finding container f890afa073b60fd219430eb2193b82638de8c414558c98a8c638cd9ca1ca59bd: Status 404 returned error can't find the container with id f890afa073b60fd219430eb2193b82638de8c414558c98a8c638cd9ca1ca59bd
Jul 16 17:36:31.759667 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.759637    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-7jpdn"
Jul 16 17:36:31.912966 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:31.912940    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-7jpdn"]
Jul 16 17:36:31.913665 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:31.913640    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedfb7ce2_b7ee_4d33_a11f_2de7432de33a.slice/crio-ac762275f81c9169771cc049595f118a7273ac6ad436785777eb88b31c00315b WatchSource:0}: Error finding container ac762275f81c9169771cc049595f118a7273ac6ad436785777eb88b31c00315b: Status 404 returned error can't find the container with id ac762275f81c9169771cc049595f118a7273ac6ad436785777eb88b31c00315b
Jul 16 17:36:32.007269 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.007237    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t2d8t\""
Jul 16 17:36:32.015580 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.015559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6j895"
Jul 16 17:36:32.152321 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.152245    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6j895"]
Jul 16 17:36:32.154155 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:32.154115    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08642b6e_37f1_48e2_a82b_cb7b47fe3827.slice/crio-81a4ab389b8a8cafcfd767ad5fcb7e20734dc9a0a18671952a4f35294d084d3d WatchSource:0}: Error finding container 81a4ab389b8a8cafcfd767ad5fcb7e20734dc9a0a18671952a4f35294d084d3d: Status 404 returned error can't find the container with id 81a4ab389b8a8cafcfd767ad5fcb7e20734dc9a0a18671952a4f35294d084d3d
Jul 16 17:36:32.215189 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.215156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsnnh\""
Jul 16 17:36:32.440391 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.440358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 17:36:32.444512 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.444495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ed2a920-8597-4db3-90ed-efb54db7aa39-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-d57tx\" (UID: \"8ed2a920-8597-4db3-90ed-efb54db7aa39\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:32.556886 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.556852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 17:36:32.562780 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.562748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ed2a920-8597-4db3-90ed-efb54db7aa39-nginx-conf\") pod \"networking-console-plugin-6cf856758c-d57tx\" (UID: \"8ed2a920-8597-4db3-90ed-efb54db7aa39\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:32.564793 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.564770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6j895" event={"ID":"08642b6e-37f1-48e2-a82b-cb7b47fe3827","Type":"ContainerStarted","Data":"81a4ab389b8a8cafcfd767ad5fcb7e20734dc9a0a18671952a4f35294d084d3d"}
Jul 16 17:36:32.565774 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.565754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-7jpdn" event={"ID":"edfb7ce2-b7ee-4d33-a11f-2de7432de33a","Type":"ContainerStarted","Data":"ac762275f81c9169771cc049595f118a7273ac6ad436785777eb88b31c00315b"}
Jul 16 17:36:32.566742 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.566725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6" event={"ID":"01d88f10-8c03-41af-9f64-4ef370ce0507","Type":"ContainerStarted","Data":"f890afa073b60fd219430eb2193b82638de8c414558c98a8c638cd9ca1ca59bd"}
Jul 16 17:36:32.622375 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:32.622350    2580 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition
Jul 16 17:36:32.622477 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:32.622419    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-image-registry-private-configuration podName:c9e4b590-c5f8-4277-b6fe-6109f7287710 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:33.122403645 +0000 UTC m=+101.758605590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-image-registry-private-configuration") pod "image-registry-66695db459-q5zrn" (UID: "c9e4b590-c5f8-4277-b6fe-6109f7287710") : failed to sync secret cache: timed out waiting for the condition
Jul 16 17:36:32.977557 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.977518    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 17:36:32.984621 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.984581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tdh8m\""
Jul 16 17:36:32.986663 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:32.986626    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx"
Jul 16 17:36:33.134699 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.134636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-image-registry-private-configuration\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:33.137786 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.137696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9e4b590-c5f8-4277-b6fe-6109f7287710-image-registry-private-configuration\") pod \"image-registry-66695db459-q5zrn\" (UID: \"c9e4b590-c5f8-4277-b6fe-6109f7287710\") " pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:33.165352 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.165257    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-d57tx"]
Jul 16 17:36:33.170142 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:33.170071    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed2a920_8597_4db3_90ed_efb54db7aa39.slice/crio-d1ea2ef09577ea0b783e91c6e9ebc1a88f96640d3bfa3fa0b03e2c396e57167b WatchSource:0}: Error finding container d1ea2ef09577ea0b783e91c6e9ebc1a88f96640d3bfa3fa0b03e2c396e57167b: Status 404 returned error can't find the container with id d1ea2ef09577ea0b783e91c6e9ebc1a88f96640d3bfa3fa0b03e2c396e57167b
Jul 16 17:36:33.186925 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.186717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:33.380056 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.380022    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66695db459-q5zrn"]
Jul 16 17:36:33.384495 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:33.384452    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e4b590_c5f8_4277_b6fe_6109f7287710.slice/crio-48acc3d11872a2f4c4fab3a4266d9a334b345feb8f6668f9813cc1e4d420b92e WatchSource:0}: Error finding container 48acc3d11872a2f4c4fab3a4266d9a334b345feb8f6668f9813cc1e4d420b92e: Status 404 returned error can't find the container with id 48acc3d11872a2f4c4fab3a4266d9a334b345feb8f6668f9813cc1e4d420b92e
Jul 16 17:36:33.455101 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.455073    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7xlv6"
Jul 16 17:36:33.573444 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.573350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66695db459-q5zrn" event={"ID":"c9e4b590-c5f8-4277-b6fe-6109f7287710","Type":"ContainerStarted","Data":"01cb9cdcbe608d17ffeb279a627ed7a7e67f350337614ec58528b38b55288c68"}
Jul 16 17:36:33.573444 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.573417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66695db459-q5zrn" event={"ID":"c9e4b590-c5f8-4277-b6fe-6109f7287710","Type":"ContainerStarted","Data":"48acc3d11872a2f4c4fab3a4266d9a334b345feb8f6668f9813cc1e4d420b92e"}
Jul 16 17:36:33.573665 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.573560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:33.575365 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.575316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx" event={"ID":"8ed2a920-8597-4db3-90ed-efb54db7aa39","Type":"ContainerStarted","Data":"d1ea2ef09577ea0b783e91c6e9ebc1a88f96640d3bfa3fa0b03e2c396e57167b"}
Jul 16 17:36:33.595978 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:33.595411    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66695db459-q5zrn" podStartSLOduration=2.595391608 podStartE2EDuration="2.595391608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:33.595135132 +0000 UTC m=+102.231337101" watchObservedRunningTime="2026-07-16 17:36:33.595391608 +0000 UTC m=+102.231593554"
Jul 16 17:36:35.834763 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.834727    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pkvsz"]
Jul 16 17:36:35.852755 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.852721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pkvsz"]
Jul 16 17:36:35.852926 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.852847    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:35.860323 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.860107    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 17:36:35.860915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.860749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q5bbt\""
Jul 16 17:36:35.860915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.860794    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 17:36:35.860915 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.860808    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 17:36:35.861885 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.861428    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 17:36:35.862418 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.862307    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 17:36:35.958976 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.958945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c476af21-df8b-4e97-9eac-68c9baae5469-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:35.959146 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.958988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfz6r\" (UniqueName: \"kubernetes.io/projected/c476af21-df8b-4e97-9eac-68c9baae5469-kube-api-access-rfz6r\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:35.959146 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.959028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c476af21-df8b-4e97-9eac-68c9baae5469-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:35.959146 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:35.959094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c476af21-df8b-4e97-9eac-68c9baae5469-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.059738 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.059699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c476af21-df8b-4e97-9eac-68c9baae5469-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.059919 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.059781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c476af21-df8b-4e97-9eac-68c9baae5469-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.059919 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.059821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfz6r\" (UniqueName: \"kubernetes.io/projected/c476af21-df8b-4e97-9eac-68c9baae5469-kube-api-access-rfz6r\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.060041 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.059922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c476af21-df8b-4e97-9eac-68c9baae5469-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.060617 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.060568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c476af21-df8b-4e97-9eac-68c9baae5469-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.062551 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.062526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c476af21-df8b-4e97-9eac-68c9baae5469-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.062651 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.062550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c476af21-df8b-4e97-9eac-68c9baae5469-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.071111 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.071086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfz6r\" (UniqueName: \"kubernetes.io/projected/c476af21-df8b-4e97-9eac-68c9baae5469-kube-api-access-rfz6r\") pod \"prometheus-operator-64785b6675-pkvsz\" (UID: \"c476af21-df8b-4e97-9eac-68c9baae5469\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.166168 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.166131    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz"
Jul 16 17:36:36.568208 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.568093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pkvsz"]
Jul 16 17:36:36.589120 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.589089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx" event={"ID":"8ed2a920-8597-4db3-90ed-efb54db7aa39","Type":"ContainerStarted","Data":"f5f34981381c87faec6aa7b6e4bee11abc658f604e65ccaddc40a440046b67df"}
Jul 16 17:36:36.591104 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.591029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6j895" event={"ID":"08642b6e-37f1-48e2-a82b-cb7b47fe3827","Type":"ContainerStarted","Data":"093a70f39fcd2ee5bc0ba37646b006e00194444162c8cdbab735ea54b6ce84cc"}
Jul 16 17:36:36.592646 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.592528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz" event={"ID":"c476af21-df8b-4e97-9eac-68c9baae5469","Type":"ContainerStarted","Data":"5c02d6c762a604d18df77fc58ec640e497822931e2242b9bd38e8c1a350f5ddc"}
Jul 16 17:36:36.594774 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.594734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6" event={"ID":"01d88f10-8c03-41af-9f64-4ef370ce0507","Type":"ContainerStarted","Data":"538f403739b908f01f82c1df677f926c778f66686ee40fbd4f9818c84d547ca6"}
Jul 16 17:36:36.629454 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.629389    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-d57tx" podStartSLOduration=2.399091544 podStartE2EDuration="5.629368062s" totalImagesPullingTime="3.230276518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:36.628965723 +0000 UTC m=+105.265167689" watchObservedRunningTime="2026-07-16 17:36:36.629368062 +0000 UTC m=+105.265570031"
Jul 16 17:36:36.870532 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.870491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:36.873210 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:36.873179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc36cf8-8882-48a3-b22a-4b671cab7694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ftsqx\" (UID: \"8fc36cf8-8882-48a3-b22a-4b671cab7694\") " pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:37.121136 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:37.121093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ftsqx"
Jul 16 17:36:37.292123 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:37.292071    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87bf4b746-7tgv6" podStartSLOduration=1.619127854 podStartE2EDuration="6.292051462s" totalImagesPullingTime="4.672923608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:36.665977336 +0000 UTC m=+105.302179305" watchObservedRunningTime="2026-07-16 17:36:37.292051462 +0000 UTC m=+105.928253430"
Jul 16 17:36:37.292363 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:37.292316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ftsqx"]
Jul 16 17:36:37.296060 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:37.296025    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc36cf8_8882_48a3_b22a_4b671cab7694.slice/crio-094cd08e1c333ac3f88dd5d8c3e732f4796a0cfec48881a0fe0375faf3b8bc7d WatchSource:0}: Error finding container 094cd08e1c333ac3f88dd5d8c3e732f4796a0cfec48881a0fe0375faf3b8bc7d: Status 404 returned error can't find the container with id 094cd08e1c333ac3f88dd5d8c3e732f4796a0cfec48881a0fe0375faf3b8bc7d
Jul 16 17:36:37.601591 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:37.601494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6j895" event={"ID":"08642b6e-37f1-48e2-a82b-cb7b47fe3827","Type":"ContainerStarted","Data":"fa242e6a6d4ecd7863556f58b1bc41ab4b90703cba61673f77b842c787b5a8a3"}
Jul 16 17:36:37.601764 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:37.601593    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6j895"
Jul 16 17:36:37.602881 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:37.602850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ftsqx" event={"ID":"8fc36cf8-8882-48a3-b22a-4b671cab7694","Type":"ContainerStarted","Data":"094cd08e1c333ac3f88dd5d8c3e732f4796a0cfec48881a0fe0375faf3b8bc7d"}
Jul 16 17:36:37.627407 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:37.627358    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6j895" podStartSLOduration=66.380624534 podStartE2EDuration="1m10.627344703s" totalImagesPullingTime="4.246720169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:37.626276466 +0000 UTC m=+106.262478435" watchObservedRunningTime="2026-07-16 17:36:37.627344703 +0000 UTC m=+106.263546649"
Jul 16 17:36:39.614900 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:39.614858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz" event={"ID":"c476af21-df8b-4e97-9eac-68c9baae5469","Type":"ContainerStarted","Data":"f627ed58e12226ee789df007e5bf600ca7b1dd599ea3e69840ba8c938752e84a"}
Jul 16 17:36:39.615413 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:39.614926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz" event={"ID":"c476af21-df8b-4e97-9eac-68c9baae5469","Type":"ContainerStarted","Data":"545cf56fd242675f8900181448328bb977bcfeee680414b976b3613571fd6b83"}
Jul 16 17:36:39.656865 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:39.656595    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-pkvsz" podStartSLOduration=2.328629701 podStartE2EDuration="4.656572947s" totalImagesPullingTime="2.327943246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:39.655921512 +0000 UTC m=+108.292123481" watchObservedRunningTime="2026-07-16 17:36:39.656572947 +0000 UTC m=+108.292774894"
Jul 16 17:36:41.344422 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.342971    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"]
Jul 16 17:36:41.359404 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.359000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.364587 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.364509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 17:36:41.366322 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.366143    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dwtqz\""
Jul 16 17:36:41.378922 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.378892    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 17:36:41.390077 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.388632    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-cs72g"]
Jul 16 17:36:41.392207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.392177    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"]
Jul 16 17:36:41.392432 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.392315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.396496 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.396244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 17:36:41.396496 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.396263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 17:36:41.397352 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.396991    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9gtqn\""
Jul 16 17:36:41.399777 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.399699    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 17:36:41.433812 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.433350    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4xzg"]
Jul 16 17:36:41.440384 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.438605    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-cs72g"]
Jul 16 17:36:41.440384 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.438942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.443801 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.443572    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 17:36:41.443801 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.443675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 17:36:41.444410 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.444149    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 17:36:41.445887 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.445871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qkjzl\""
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.516974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmbkj\" (UniqueName: \"kubernetes.io/projected/261749ae-2172-46e5-8d05-2889805f487c-kube-api-access-bmbkj\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/261749ae-2172-46e5-8d05-2889805f487c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzmvq\" (UniqueName: \"kubernetes.io/projected/fd91a21c-0e28-472c-875f-c0f946eda1e4-kube-api-access-wzmvq\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/261749ae-2172-46e5-8d05-2889805f487c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd91a21c-0e28-472c-875f-c0f946eda1e4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.517445 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.517295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.618684 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.618684 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-root\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.618684 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-textfile\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.618684 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251765a9-10b3-42e7-a064-e469e3a2c3d3-metrics-client-ca\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.618684 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.618684 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:41.618639    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmbkj\" (UniqueName: \"kubernetes.io/projected/261749ae-2172-46e5-8d05-2889805f487c-kube-api-access-bmbkj\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:41.618712    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-tls podName:fd91a21c-0e28-472c-875f-c0f946eda1e4 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:42.118692734 +0000 UTC m=+110.754894686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-bf8kt" (UID: "fd91a21c-0e28-472c-875f-c0f946eda1e4") : secret "openshift-state-metrics-tls" not found
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-tls\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/261749ae-2172-46e5-8d05-2889805f487c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmvq\" (UniqueName: \"kubernetes.io/projected/fd91a21c-0e28-472c-875f-c0f946eda1e4-kube-api-access-wzmvq\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.618979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-wtmp\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.619004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24f9\" (UniqueName: \"kubernetes.io/projected/251765a9-10b3-42e7-a064-e469e3a2c3d3-kube-api-access-c24f9\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.619043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/261749ae-2172-46e5-8d05-2889805f487c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.619068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.619134 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.619107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd91a21c-0e28-472c-875f-c0f946eda1e4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.619811 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.619130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-sys\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.620119 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.620069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/261749ae-2172-46e5-8d05-2889805f487c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.620252 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.620230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/261749ae-2172-46e5-8d05-2889805f487c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.620362 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.620238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd91a21c-0e28-472c-875f-c0f946eda1e4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.620712 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.620617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.622345 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.621759    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.625538 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.625513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.625897 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.625854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/261749ae-2172-46e5-8d05-2889805f487c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.635701 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.635678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmbkj\" (UniqueName: \"kubernetes.io/projected/261749ae-2172-46e5-8d05-2889805f487c-kube-api-access-bmbkj\") pod \"kube-state-metrics-785778ff74-cs72g\" (UID: \"261749ae-2172-46e5-8d05-2889805f487c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.636380 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.636274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzmvq\" (UniqueName: \"kubernetes.io/projected/fd91a21c-0e28-472c-875f-c0f946eda1e4-kube-api-access-wzmvq\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:41.720392 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720392 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-sys\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720632 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-root\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720632 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-textfile\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720632 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251765a9-10b3-42e7-a064-e469e3a2c3d3-metrics-client-ca\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720632 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720632 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-tls\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720871 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-wtmp\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.720871 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.720657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c24f9\" (UniqueName: \"kubernetes.io/projected/251765a9-10b3-42e7-a064-e469e3a2c3d3-kube-api-access-c24f9\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.721651 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.721008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-sys\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.721651 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.721205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-root\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.721651 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.721254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-textfile\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.721651 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:41.721276    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 17:36:41.721651 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:36:41.721356    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-tls podName:251765a9-10b3-42e7-a064-e469e3a2c3d3 nodeName:}" failed. No retries permitted until 2026-07-16 17:36:42.221337071 +0000 UTC m=+110.857539051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-tls") pod "node-exporter-s4xzg" (UID: "251765a9-10b3-42e7-a064-e469e3a2c3d3") : secret "node-exporter-tls" not found
Jul 16 17:36:41.721651 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.721638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-wtmp\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.721978 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.721872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251765a9-10b3-42e7-a064-e469e3a2c3d3-metrics-client-ca\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.722379 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.722317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.724338 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.724275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:41.731378 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.731356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g"
Jul 16 17:36:41.732180 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:41.732100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24f9\" (UniqueName: \"kubernetes.io/projected/251765a9-10b3-42e7-a064-e469e3a2c3d3-kube-api-access-c24f9\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:42.125207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:42.125071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:42.127940 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:42.127906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd91a21c-0e28-472c-875f-c0f946eda1e4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bf8kt\" (UID: \"fd91a21c-0e28-472c-875f-c0f946eda1e4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:42.225874 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:42.225837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-tls\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:42.228707 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:42.228652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/251765a9-10b3-42e7-a064-e469e3a2c3d3-node-exporter-tls\") pod \"node-exporter-s4xzg\" (UID: \"251765a9-10b3-42e7-a064-e469e3a2c3d3\") " pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:42.271599 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:42.271570    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"
Jul 16 17:36:42.353275 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:42.353236    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4xzg"
Jul 16 17:36:43.288764 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:43.288721    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251765a9_10b3_42e7_a064_e469e3a2c3d3.slice/crio-f6c7a7f6b7161285f55f0525ca5b69c974641f48c3ab7e36a365f11205aa4aea WatchSource:0}: Error finding container f6c7a7f6b7161285f55f0525ca5b69c974641f48c3ab7e36a365f11205aa4aea: Status 404 returned error can't find the container with id f6c7a7f6b7161285f55f0525ca5b69c974641f48c3ab7e36a365f11205aa4aea
Jul 16 17:36:43.456198 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.456053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-cs72g"]
Jul 16 17:36:43.459059 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:43.459032    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261749ae_2172_46e5_8d05_2889805f487c.slice/crio-c76c618a12415c08fbd4a39d39170a0a723ccc31c309f8938a4642d68b9d09a5 WatchSource:0}: Error finding container c76c618a12415c08fbd4a39d39170a0a723ccc31c309f8938a4642d68b9d09a5: Status 404 returned error can't find the container with id c76c618a12415c08fbd4a39d39170a0a723ccc31c309f8938a4642d68b9d09a5
Jul 16 17:36:43.484700 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.484668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt"]
Jul 16 17:36:43.488306 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:36:43.488263    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd91a21c_0e28_472c_875f_c0f946eda1e4.slice/crio-01e8a57142805d65279c9e39831544a1051dd0f35b81e19f24d430dac57878a3 WatchSource:0}: Error finding container 01e8a57142805d65279c9e39831544a1051dd0f35b81e19f24d430dac57878a3: Status 404 returned error can't find the container with id 01e8a57142805d65279c9e39831544a1051dd0f35b81e19f24d430dac57878a3
Jul 16 17:36:43.638347 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.638312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g" event={"ID":"261749ae-2172-46e5-8d05-2889805f487c","Type":"ContainerStarted","Data":"c76c618a12415c08fbd4a39d39170a0a723ccc31c309f8938a4642d68b9d09a5"}
Jul 16 17:36:43.639646 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.639621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4xzg" event={"ID":"251765a9-10b3-42e7-a064-e469e3a2c3d3","Type":"ContainerStarted","Data":"f6c7a7f6b7161285f55f0525ca5b69c974641f48c3ab7e36a365f11205aa4aea"}
Jul 16 17:36:43.642001 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.641976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt" event={"ID":"fd91a21c-0e28-472c-875f-c0f946eda1e4","Type":"ContainerStarted","Data":"0a3761196e2b2f215d57b3543e43be9b09b2ed46d05533e22128bc2070b74fb5"}
Jul 16 17:36:43.642082 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.642030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt" event={"ID":"fd91a21c-0e28-472c-875f-c0f946eda1e4","Type":"ContainerStarted","Data":"b1b286d72d9bdfb55dbaa92cb6d165d12708b197d49cbe7aa212daf80fd07c25"}
Jul 16 17:36:43.642082 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.642059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt" event={"ID":"fd91a21c-0e28-472c-875f-c0f946eda1e4","Type":"ContainerStarted","Data":"01e8a57142805d65279c9e39831544a1051dd0f35b81e19f24d430dac57878a3"}
Jul 16 17:36:43.644871 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:43.644846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ftsqx" event={"ID":"8fc36cf8-8882-48a3-b22a-4b671cab7694","Type":"ContainerStarted","Data":"bc8ec897f96b91bf2df2105662ef2daf33a5c3dd9d4b686edd85247e19998229"}
Jul 16 17:36:45.657679 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:45.657637    2580 generic.go:356] "Generic (PLEG): container finished" podID="251765a9-10b3-42e7-a064-e469e3a2c3d3" containerID="94203cdb20a2ef546d489da545271c97a07a6490b806de0e7b4b77c17a22e9c9" exitCode=0
Jul 16 17:36:45.658152 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:45.657711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4xzg" event={"ID":"251765a9-10b3-42e7-a064-e469e3a2c3d3","Type":"ContainerDied","Data":"94203cdb20a2ef546d489da545271c97a07a6490b806de0e7b4b77c17a22e9c9"}
Jul 16 17:36:47.611932 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:47.611883    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6j895"
Jul 16 17:36:54.583449 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:54.583420    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66695db459-q5zrn"
Jul 16 17:36:56.712333 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.711479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4xzg" event={"ID":"251765a9-10b3-42e7-a064-e469e3a2c3d3","Type":"ContainerStarted","Data":"688ba07bd488bbd752e704d475c6b66489b5b3979655e0505410d73b7c8a90b9"}
Jul 16 17:36:56.712333 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.711595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4xzg" event={"ID":"251765a9-10b3-42e7-a064-e469e3a2c3d3","Type":"ContainerStarted","Data":"f149633ca8484b9b23075cd8109749c0f3cd4821e2763560a5ed977f2518d62b"}
Jul 16 17:36:56.715634 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.715563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt" event={"ID":"fd91a21c-0e28-472c-875f-c0f946eda1e4","Type":"ContainerStarted","Data":"4f5268d18c8c6d5b8d6b8c79385ac7c57cd5301184186523b150bf12c2b07b1d"}
Jul 16 17:36:56.717936 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.717906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ftsqx" event={"ID":"8fc36cf8-8882-48a3-b22a-4b671cab7694","Type":"ContainerStarted","Data":"ba8089f84e595d13dc26278094f3a2d027720ab3a91eea36863cb748b79698a6"}
Jul 16 17:36:56.719831 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.719803    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-7jpdn" event={"ID":"edfb7ce2-b7ee-4d33-a11f-2de7432de33a","Type":"ContainerStarted","Data":"1af85e14674fb0ef3979f527409ea197c7acedd1b4af8575d60be482632e85c4"}
Jul 16 17:36:56.720626 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.720610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-7jpdn"
Jul 16 17:36:56.723081 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.723031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g" event={"ID":"261749ae-2172-46e5-8d05-2889805f487c","Type":"ContainerStarted","Data":"158fa3bb9b189e7ad4b427935b983b5c61478a927e6c1aaaf23d50ffa1b94eea"}
Jul 16 17:36:56.723181 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.723088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g" event={"ID":"261749ae-2172-46e5-8d05-2889805f487c","Type":"ContainerStarted","Data":"c388d7da65e2454f6f87f43432e3bf27486a2496c5e5ada6a57ca6a96fc26239"}
Jul 16 17:36:56.723181 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.723120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g" event={"ID":"261749ae-2172-46e5-8d05-2889805f487c","Type":"ContainerStarted","Data":"ec28f999d1463a9046b4b82d78f89a3611b95cb0b430713e28207b5c60989e02"}
Jul 16 17:36:56.726171 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.726122    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-7jpdn"
Jul 16 17:36:56.736623 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.736468    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4xzg" podStartSLOduration=14.027101513 podStartE2EDuration="15.736447154s" totalImagesPullingTime="1.628786352s" totalInitContainerRuntime="80.559289ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:56.735054336 +0000 UTC m=+125.371256305" watchObservedRunningTime="2026-07-16 17:36:56.736447154 +0000 UTC m=+125.372649188"
Jul 16 17:36:56.764136 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.764067    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-7jpdn" podStartSLOduration=1.6246838129999999 podStartE2EDuration="25.76404801s" totalImagesPullingTime="24.139364197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:56.763972447 +0000 UTC m=+125.400174416" watchObservedRunningTime="2026-07-16 17:36:56.76404801 +0000 UTC m=+125.400249981"
Jul 16 17:36:56.804516 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.803354    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bf8kt" podStartSLOduration=3.332085601 podStartE2EDuration="15.803331161s" totalImagesPullingTime="12.47124556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:56.802771586 +0000 UTC m=+125.438973554" watchObservedRunningTime="2026-07-16 17:36:56.803331161 +0000 UTC m=+125.439533131"
Jul 16 17:36:56.828385 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:36:56.828325    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-cs72g" podStartSLOduration=3.211561659 podStartE2EDuration="15.828302333s" totalImagesPullingTime="12.616740674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:56.827383577 +0000 UTC m=+125.463585546" watchObservedRunningTime="2026-07-16 17:36:56.828302333 +0000 UTC m=+125.464504299"
Jul 16 17:37:01.697317 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:01.697251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:37:01.700013 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:01.699980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2cd0c26-0ee6-4e7b-a208-397602a25675-metrics-certs\") pod \"network-metrics-daemon-5dnnt\" (UID: \"b2cd0c26-0ee6-4e7b-a208-397602a25675\") " pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:37:01.749570 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:01.749527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ftsqx" event={"ID":"8fc36cf8-8882-48a3-b22a-4b671cab7694","Type":"ContainerStarted","Data":"18d9a1403856e85d71a6d550eb9382e07dfc90515ee392c3c9b8cd31a1e4a97f"}
Jul 16 17:37:01.774724 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:01.774672    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ftsqx" podStartSLOduration=34.047218574 podStartE2EDuration="57.77465239s" totalImagesPullingTime="23.727433816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:36:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:37:01.773185988 +0000 UTC m=+130.409387957" watchObservedRunningTime="2026-07-16 17:37:01.77465239 +0000 UTC m=+130.410854357"
Jul 16 17:37:01.805216 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:01.805187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4hnr\""
Jul 16 17:37:01.812875 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:01.812850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dnnt"
Jul 16 17:37:02.025235 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:02.025118    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dnnt"]
Jul 16 17:37:02.755778 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:02.755736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dnnt" event={"ID":"b2cd0c26-0ee6-4e7b-a208-397602a25675","Type":"ContainerStarted","Data":"dc100f603eb428afcc38beac9433ef53d66c29eda10abd22752d19cba8191585"}
Jul 16 17:37:05.772167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:05.772121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dnnt" event={"ID":"b2cd0c26-0ee6-4e7b-a208-397602a25675","Type":"ContainerStarted","Data":"0139704565f5c01ada433c1d624e123d1e45ad23c74665b461ef9234562690c4"}
Jul 16 17:37:05.772575 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:05.772205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dnnt" event={"ID":"b2cd0c26-0ee6-4e7b-a208-397602a25675","Type":"ContainerStarted","Data":"206e64988080edd01ae1e31eed558cc06607f46f662b0cba6900957a9f06f828"}
Jul 16 17:37:05.800646 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:05.800572    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5dnnt" podStartSLOduration=131.039996954 podStartE2EDuration="2m13.800531396s" totalImagesPullingTime="2.760534442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:37:05.798589962 +0000 UTC m=+134.434791930" watchObservedRunningTime="2026-07-16 17:37:05.800531396 +0000 UTC m=+134.436733364"
Jul 16 17:37:31.867560 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:31.867523    2580 generic.go:356] "Generic (PLEG): container finished" podID="fea963ca-8f54-4efb-ac8d-e68a31099d96" containerID="44eb5e7bd68f43c385cc39e198b5cc924db4e70813ef82add9369d2742ac4f6d" exitCode=0
Jul 16 17:37:31.867946 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:31.867577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb" event={"ID":"fea963ca-8f54-4efb-ac8d-e68a31099d96","Type":"ContainerDied","Data":"44eb5e7bd68f43c385cc39e198b5cc924db4e70813ef82add9369d2742ac4f6d"}
Jul 16 17:37:31.867946 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:31.867854    2580 scope.go:117] "RemoveContainer" containerID="44eb5e7bd68f43c385cc39e198b5cc924db4e70813ef82add9369d2742ac4f6d"
Jul 16 17:37:32.872923 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:32.872886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lk6hb" event={"ID":"fea963ca-8f54-4efb-ac8d-e68a31099d96","Type":"ContainerStarted","Data":"baf0de806b3f8a3cb0d0af86176f6b366549899430b82a4934411f39a00d2398"}
Jul 16 17:37:36.889758 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:36.889720    2580 generic.go:356] "Generic (PLEG): container finished" podID="5306ef8d-66c7-41d6-a93b-7948ad43ade2" containerID="6c298804a47f1782fd10e9060e3cbf79d8dd2f5897e00d2e65e1141ce58c33c1" exitCode=0
Jul 16 17:37:36.890180 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:36.889795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d" event={"ID":"5306ef8d-66c7-41d6-a93b-7948ad43ade2","Type":"ContainerDied","Data":"6c298804a47f1782fd10e9060e3cbf79d8dd2f5897e00d2e65e1141ce58c33c1"}
Jul 16 17:37:36.890180 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:36.890116    2580 scope.go:117] "RemoveContainer" containerID="6c298804a47f1782fd10e9060e3cbf79d8dd2f5897e00d2e65e1141ce58c33c1"
Jul 16 17:37:37.894959 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:37:37.894920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l9v9d" event={"ID":"5306ef8d-66c7-41d6-a93b-7948ad43ade2","Type":"ContainerStarted","Data":"a49a7e15c8f299087426bad75e90b80858b8c3f074d9ae4eacf8270a7ef610c1"}
Jul 16 17:39:51.867976 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:39:51.867943    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:39:51.868419 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:39:51.868199    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:39:51.872666 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:39:51.872642    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:39:51.873200 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:39:51.873183    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:39:51.878416 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:39:51.878399    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 17:41:17.251516 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.251475    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-5k44d"]
Jul 16 17:41:17.254189 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.254164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.258664 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.258642    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-g4k2w\""
Jul 16 17:41:17.259358 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.259337    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 16 17:41:17.259476 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.259339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 16 17:41:17.259476 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.259388    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 16 17:41:17.259476 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.259339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 16 17:41:17.286983 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.286957    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-5k44d"]
Jul 16 17:41:17.306536 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.306510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhvnc\" (UniqueName: \"kubernetes.io/projected/e46f58e7-3bd5-48af-910a-92584486bb0b-kube-api-access-zhvnc\") pod \"keda-admission-56f9798bb4-5k44d\" (UID: \"e46f58e7-3bd5-48af-910a-92584486bb0b\") " pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.306689 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.306559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e46f58e7-3bd5-48af-910a-92584486bb0b-certificates\") pod \"keda-admission-56f9798bb4-5k44d\" (UID: \"e46f58e7-3bd5-48af-910a-92584486bb0b\") " pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.407744 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.407712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e46f58e7-3bd5-48af-910a-92584486bb0b-certificates\") pod \"keda-admission-56f9798bb4-5k44d\" (UID: \"e46f58e7-3bd5-48af-910a-92584486bb0b\") " pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.407903 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.407783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhvnc\" (UniqueName: \"kubernetes.io/projected/e46f58e7-3bd5-48af-910a-92584486bb0b-kube-api-access-zhvnc\") pod \"keda-admission-56f9798bb4-5k44d\" (UID: \"e46f58e7-3bd5-48af-910a-92584486bb0b\") " pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.410303 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.410257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e46f58e7-3bd5-48af-910a-92584486bb0b-certificates\") pod \"keda-admission-56f9798bb4-5k44d\" (UID: \"e46f58e7-3bd5-48af-910a-92584486bb0b\") " pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.433066 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.433034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhvnc\" (UniqueName: \"kubernetes.io/projected/e46f58e7-3bd5-48af-910a-92584486bb0b-kube-api-access-zhvnc\") pod \"keda-admission-56f9798bb4-5k44d\" (UID: \"e46f58e7-3bd5-48af-910a-92584486bb0b\") " pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.566481 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.566396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:17.715397 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.715035    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-5k44d"]
Jul 16 17:41:17.717732 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:41:17.717704    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46f58e7_3bd5_48af_910a_92584486bb0b.slice/crio-bb62c48b0c4fefa0c239cc4c15d7b4a31cb27948857be17073af249a12a2455a WatchSource:0}: Error finding container bb62c48b0c4fefa0c239cc4c15d7b4a31cb27948857be17073af249a12a2455a: Status 404 returned error can't find the container with id bb62c48b0c4fefa0c239cc4c15d7b4a31cb27948857be17073af249a12a2455a
Jul 16 17:41:17.719012 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:17.718988    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:41:18.715344 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:18.715304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-5k44d" event={"ID":"e46f58e7-3bd5-48af-910a-92584486bb0b","Type":"ContainerStarted","Data":"bb62c48b0c4fefa0c239cc4c15d7b4a31cb27948857be17073af249a12a2455a"}
Jul 16 17:41:20.726417 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:20.726372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-5k44d" event={"ID":"e46f58e7-3bd5-48af-910a-92584486bb0b","Type":"ContainerStarted","Data":"e9ac61488b49a315240db53bcfe03a00ae0c6f666711d9a002701c91b373ae86"}
Jul 16 17:41:20.726894 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:20.726522    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:41:20.751686 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:20.751639    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-5k44d" podStartSLOduration=1.319711632 podStartE2EDuration="3.751623519s" totalImagesPullingTime="2.431911887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:20.749862929 +0000 UTC m=+389.386064897" watchObservedRunningTime="2026-07-16 17:41:20.751623519 +0000 UTC m=+389.387825486"
Jul 16 17:41:41.733897 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:41:41.733863    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-5k44d"
Jul 16 17:42:27.204765 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.204680    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-ss7x8"]
Jul 16 17:42:27.208156 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.208134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.210687 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.210663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 16 17:42:27.210787 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.210738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 16 17:42:27.211619 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.211602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 16 17:42:27.211764 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.211622    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-zt9dg\""
Jul 16 17:42:27.220808 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.220783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-ss7x8"]
Jul 16 17:42:27.251019 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.250993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d165700b-e9b0-4994-9c1f-6a1d68a934d5-cert\") pod \"kserve-controller-manager-576d7b7757-ss7x8\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") " pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.251125 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.251031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw4rm\" (UniqueName: \"kubernetes.io/projected/d165700b-e9b0-4994-9c1f-6a1d68a934d5-kube-api-access-lw4rm\") pod \"kserve-controller-manager-576d7b7757-ss7x8\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") " pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.275060 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.275029    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-tnr46"]
Jul 16 17:42:27.278166 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.278147    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.281436 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.281415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-52rtb\""
Jul 16 17:42:27.281549 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.281537    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 16 17:42:27.290084 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.290061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-tnr46"]
Jul 16 17:42:27.352500 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.352449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d165700b-e9b0-4994-9c1f-6a1d68a934d5-cert\") pod \"kserve-controller-manager-576d7b7757-ss7x8\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") " pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.352500 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.352495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw4rm\" (UniqueName: \"kubernetes.io/projected/d165700b-e9b0-4994-9c1f-6a1d68a934d5-kube-api-access-lw4rm\") pod \"kserve-controller-manager-576d7b7757-ss7x8\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") " pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.352722 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.352651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82bbe50c-3fb4-4015-9820-0ab0596e3a3c-data\") pod \"seaweedfs-64568bcd49-tnr46\" (UID: \"82bbe50c-3fb4-4015-9820-0ab0596e3a3c\") " pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.352798 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.352775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcdf2\" (UniqueName: \"kubernetes.io/projected/82bbe50c-3fb4-4015-9820-0ab0596e3a3c-kube-api-access-gcdf2\") pod \"seaweedfs-64568bcd49-tnr46\" (UID: \"82bbe50c-3fb4-4015-9820-0ab0596e3a3c\") " pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.354974 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.354945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d165700b-e9b0-4994-9c1f-6a1d68a934d5-cert\") pod \"kserve-controller-manager-576d7b7757-ss7x8\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") " pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.363055 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.363027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw4rm\" (UniqueName: \"kubernetes.io/projected/d165700b-e9b0-4994-9c1f-6a1d68a934d5-kube-api-access-lw4rm\") pod \"kserve-controller-manager-576d7b7757-ss7x8\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") " pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.453918 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.453890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcdf2\" (UniqueName: \"kubernetes.io/projected/82bbe50c-3fb4-4015-9820-0ab0596e3a3c-kube-api-access-gcdf2\") pod \"seaweedfs-64568bcd49-tnr46\" (UID: \"82bbe50c-3fb4-4015-9820-0ab0596e3a3c\") " pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.454080 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.453948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82bbe50c-3fb4-4015-9820-0ab0596e3a3c-data\") pod \"seaweedfs-64568bcd49-tnr46\" (UID: \"82bbe50c-3fb4-4015-9820-0ab0596e3a3c\") " pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.454255 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.454241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82bbe50c-3fb4-4015-9820-0ab0596e3a3c-data\") pod \"seaweedfs-64568bcd49-tnr46\" (UID: \"82bbe50c-3fb4-4015-9820-0ab0596e3a3c\") " pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.464700 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.464632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcdf2\" (UniqueName: \"kubernetes.io/projected/82bbe50c-3fb4-4015-9820-0ab0596e3a3c-kube-api-access-gcdf2\") pod \"seaweedfs-64568bcd49-tnr46\" (UID: \"82bbe50c-3fb4-4015-9820-0ab0596e3a3c\") " pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.518013 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.517986    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:27.586533 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.586504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:27.651808 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.651782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-ss7x8"]
Jul 16 17:42:27.654910 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:42:27.654880    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd165700b_e9b0_4994_9c1f_6a1d68a934d5.slice/crio-35d472f1d913f3802faa31234188ad001f42f99ad90a67fa554236a00f7c0db9 WatchSource:0}: Error finding container 35d472f1d913f3802faa31234188ad001f42f99ad90a67fa554236a00f7c0db9: Status 404 returned error can't find the container with id 35d472f1d913f3802faa31234188ad001f42f99ad90a67fa554236a00f7c0db9
Jul 16 17:42:27.732021 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.731938    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-tnr46"]
Jul 16 17:42:27.734746 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:42:27.734719    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82bbe50c_3fb4_4015_9820_0ab0596e3a3c.slice/crio-92248e73d7b527ff8c03329ceb2e90c34abd41f7077fc216ed63c3bb25357b5f WatchSource:0}: Error finding container 92248e73d7b527ff8c03329ceb2e90c34abd41f7077fc216ed63c3bb25357b5f: Status 404 returned error can't find the container with id 92248e73d7b527ff8c03329ceb2e90c34abd41f7077fc216ed63c3bb25357b5f
Jul 16 17:42:27.987270 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.987191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8" event={"ID":"d165700b-e9b0-4994-9c1f-6a1d68a934d5","Type":"ContainerStarted","Data":"35d472f1d913f3802faa31234188ad001f42f99ad90a67fa554236a00f7c0db9"}
Jul 16 17:42:27.988262 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:27.988240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-tnr46" event={"ID":"82bbe50c-3fb4-4015-9820-0ab0596e3a3c","Type":"ContainerStarted","Data":"92248e73d7b527ff8c03329ceb2e90c34abd41f7077fc216ed63c3bb25357b5f"}
Jul 16 17:42:32.006098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:32.006005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-tnr46" event={"ID":"82bbe50c-3fb4-4015-9820-0ab0596e3a3c","Type":"ContainerStarted","Data":"c620915bd666f3fe3493d207f6fd86b4707c9ebdeeeb649d2f3e8a131273f6f9"}
Jul 16 17:42:32.006098 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:32.006083    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:32.007645 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:32.007621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8" event={"ID":"d165700b-e9b0-4994-9c1f-6a1d68a934d5","Type":"ContainerStarted","Data":"8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b"}
Jul 16 17:42:32.007792 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:32.007763    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:42:32.038375 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:32.038330    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-tnr46" podStartSLOduration=1.452411021 podStartE2EDuration="5.038308477s" totalImagesPullingTime="3.585897456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:42:32.036103522 +0000 UTC m=+460.672305504" watchObservedRunningTime="2026-07-16 17:42:32.038308477 +0000 UTC m=+460.674510444"
Jul 16 17:42:38.013473 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:38.013429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-tnr46"
Jul 16 17:42:38.033108 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:42:38.033063    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8" podStartSLOduration=7.455209616 podStartE2EDuration="11.033048846s" totalImagesPullingTime="3.57783923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:42:32.06418631 +0000 UTC m=+460.700388279" watchObservedRunningTime="2026-07-16 17:42:38.033048846 +0000 UTC m=+466.669250814"
Jul 16 17:43:03.016417 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:03.016387    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:43:39.524937 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.524897    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"]
Jul 16 17:43:39.527475 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.527458    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.532372 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.532347    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 17:43:39.532700 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.532683    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:43:39.533323 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.533299    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rjpw2\""
Jul 16 17:43:39.612629 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.612595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"]
Jul 16 17:43:39.644439 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.644399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4znm\" (UniqueName: \"kubernetes.io/projected/204f0bcf-c289-467b-9d70-5faaa9667ad3-kube-api-access-c4znm\") pod \"openshift-lws-operator-fd8ccff4c-2hxnc\" (UID: \"204f0bcf-c289-467b-9d70-5faaa9667ad3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.644439 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.644447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204f0bcf-c289-467b-9d70-5faaa9667ad3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2hxnc\" (UID: \"204f0bcf-c289-467b-9d70-5faaa9667ad3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.745190 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.745158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4znm\" (UniqueName: \"kubernetes.io/projected/204f0bcf-c289-467b-9d70-5faaa9667ad3-kube-api-access-c4znm\") pod \"openshift-lws-operator-fd8ccff4c-2hxnc\" (UID: \"204f0bcf-c289-467b-9d70-5faaa9667ad3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.745365 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.745199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204f0bcf-c289-467b-9d70-5faaa9667ad3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2hxnc\" (UID: \"204f0bcf-c289-467b-9d70-5faaa9667ad3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.745582 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.745564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204f0bcf-c289-467b-9d70-5faaa9667ad3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2hxnc\" (UID: \"204f0bcf-c289-467b-9d70-5faaa9667ad3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.769849 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.769814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4znm\" (UniqueName: \"kubernetes.io/projected/204f0bcf-c289-467b-9d70-5faaa9667ad3-kube-api-access-c4znm\") pod \"openshift-lws-operator-fd8ccff4c-2hxnc\" (UID: \"204f0bcf-c289-467b-9d70-5faaa9667ad3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.837160 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.837062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"
Jul 16 17:43:39.980313 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:39.980249    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc"]
Jul 16 17:43:39.984591 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:43:39.984557    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod204f0bcf_c289_467b_9d70_5faaa9667ad3.slice/crio-987d61db5da4fec48b79659d120be6d46f70c589938d6c1014bacb245d736d5c WatchSource:0}: Error finding container 987d61db5da4fec48b79659d120be6d46f70c589938d6c1014bacb245d736d5c: Status 404 returned error can't find the container with id 987d61db5da4fec48b79659d120be6d46f70c589938d6c1014bacb245d736d5c
Jul 16 17:43:40.267082 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:40.267041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc" event={"ID":"204f0bcf-c289-467b-9d70-5faaa9667ad3","Type":"ContainerStarted","Data":"987d61db5da4fec48b79659d120be6d46f70c589938d6c1014bacb245d736d5c"}
Jul 16 17:43:43.281812 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:43.281729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc" event={"ID":"204f0bcf-c289-467b-9d70-5faaa9667ad3","Type":"ContainerStarted","Data":"92385ba3e1303bba84db145766ccaf8c69ad25064eb8a74438bcdb234727eecf"}
Jul 16 17:43:43.322263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:43.322204    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2hxnc" podStartSLOduration=1.534371191 podStartE2EDuration="4.322188949s" totalImagesPullingTime="2.787817758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:43.321883421 +0000 UTC m=+531.958085391" watchObservedRunningTime="2026-07-16 17:43:43.322188949 +0000 UTC m=+531.958390917"
Jul 16 17:43:55.060057 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.060020    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"]
Jul 16 17:43:55.062550 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.062528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.064954 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.064930    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 17:43:55.065142 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.064994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 17:43:55.065220 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.065202    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 17:43:55.065341 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.065218    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 17:43:55.065341 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.065252    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m8494\""
Jul 16 17:43:55.065341 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.065263    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 17:43:55.065569 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.065553    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 17:43:55.076745 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.076723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"]
Jul 16 17:43:55.170079 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.170042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.170079 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.170079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/247c3d33-3bd8-4566-9752-08f0fd38caa4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.170321 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.170102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.170321 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.170197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.170321 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.170224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.170321 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.170250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.170452 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.170328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqngf\" (UniqueName: \"kubernetes.io/projected/247c3d33-3bd8-4566-9752-08f0fd38caa4-kube-api-access-tqngf\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.271255 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.271213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.271255 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.271256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/247c3d33-3bd8-4566-9752-08f0fd38caa4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.271504 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.271299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.271504 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.271356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.271504 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.271381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.271504 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.271412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.271686 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.271535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqngf\" (UniqueName: \"kubernetes.io/projected/247c3d33-3bd8-4566-9752-08f0fd38caa4-kube-api-access-tqngf\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.272116 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.272094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.273771 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.273740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.273857 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.273803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.273983 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.273966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/247c3d33-3bd8-4566-9752-08f0fd38caa4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.274110 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.274087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.283129 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.283103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/247c3d33-3bd8-4566-9752-08f0fd38caa4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.285433 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.285414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqngf\" (UniqueName: \"kubernetes.io/projected/247c3d33-3bd8-4566-9752-08f0fd38caa4-kube-api-access-tqngf\") pod \"istiod-openshift-gateway-94bb8fbfd-wnhkc\" (UID: \"247c3d33-3bd8-4566-9752-08f0fd38caa4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.372241 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.372219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:55.506296 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:55.506254    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"]
Jul 16 17:43:55.509089 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:43:55.509065    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247c3d33_3bd8_4566_9752_08f0fd38caa4.slice/crio-7ef1b6f37debd3346c80acfc9ecd89c095b35babfa44cb5f53ae00bba830ea86 WatchSource:0}: Error finding container 7ef1b6f37debd3346c80acfc9ecd89c095b35babfa44cb5f53ae00bba830ea86: Status 404 returned error can't find the container with id 7ef1b6f37debd3346c80acfc9ecd89c095b35babfa44cb5f53ae00bba830ea86
Jul 16 17:43:56.340627 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:56.340583    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc" event={"ID":"247c3d33-3bd8-4566-9752-08f0fd38caa4","Type":"ContainerStarted","Data":"7ef1b6f37debd3346c80acfc9ecd89c095b35babfa44cb5f53ae00bba830ea86"}
Jul 16 17:43:58.130746 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:58.130714    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:43:58.131005 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:58.130779    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:43:58.350703 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:58.350667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc" event={"ID":"247c3d33-3bd8-4566-9752-08f0fd38caa4","Type":"ContainerStarted","Data":"d732b27e016e01bb1adcf5213d2c63694af6d15b5c5e703f60ca8a3a8f9e8bb3"}
Jul 16 17:43:58.350894 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:58.350789    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:43:58.376047 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:58.376001    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc" podStartSLOduration=0.756646495 podStartE2EDuration="3.375985588s" totalImagesPullingTime="2.619339093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:58.373991103 +0000 UTC m=+547.010193071" watchObservedRunningTime="2026-07-16 17:43:58.375985588 +0000 UTC m=+547.012187556"
Jul 16 17:43:59.356390 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:59.356354    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-wnhkc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 17:43:59.356732 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:43:59.356419    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc" podUID="247c3d33-3bd8-4566-9752-08f0fd38caa4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 17:44:02.355617 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:02.355582    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc"
Jul 16 17:44:28.308720 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.308685    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"]
Jul 16 17:44:28.315149 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.315130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"
Jul 16 17:44:28.318051 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.318028    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 17:44:28.318051 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.318034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tzq5q\""
Jul 16 17:44:28.318988 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.318972    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 17:44:28.336366 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.336329    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"]
Jul 16 17:44:28.435175 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.435143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9m79\" (UniqueName: \"kubernetes.io/projected/ca7f2d10-4942-472d-bf28-c9f271a3264c-kube-api-access-v9m79\") pod \"limitador-operator-controller-manager-6f9f468797-5j59b\" (UID: \"ca7f2d10-4942-472d-bf28-c9f271a3264c\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"
Jul 16 17:44:28.536458 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.536429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9m79\" (UniqueName: \"kubernetes.io/projected/ca7f2d10-4942-472d-bf28-c9f271a3264c-kube-api-access-v9m79\") pod \"limitador-operator-controller-manager-6f9f468797-5j59b\" (UID: \"ca7f2d10-4942-472d-bf28-c9f271a3264c\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"
Jul 16 17:44:28.549763 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.549738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9m79\" (UniqueName: \"kubernetes.io/projected/ca7f2d10-4942-472d-bf28-c9f271a3264c-kube-api-access-v9m79\") pod \"limitador-operator-controller-manager-6f9f468797-5j59b\" (UID: \"ca7f2d10-4942-472d-bf28-c9f271a3264c\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"
Jul 16 17:44:28.625710 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.625684    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"
Jul 16 17:44:28.755205 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:28.755180    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"]
Jul 16 17:44:28.757524 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:44:28.757479    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7f2d10_4942_472d_bf28_c9f271a3264c.slice/crio-d1b5431187288485a62ced8eb995fe9a83b5864987742f99cef02c2bb43c1835 WatchSource:0}: Error finding container d1b5431187288485a62ced8eb995fe9a83b5864987742f99cef02c2bb43c1835: Status 404 returned error can't find the container with id d1b5431187288485a62ced8eb995fe9a83b5864987742f99cef02c2bb43c1835
Jul 16 17:44:29.474791 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:29.474747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b" event={"ID":"ca7f2d10-4942-472d-bf28-c9f271a3264c","Type":"ContainerStarted","Data":"d1b5431187288485a62ced8eb995fe9a83b5864987742f99cef02c2bb43c1835"}
Jul 16 17:44:31.483822 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:31.483779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b" event={"ID":"ca7f2d10-4942-472d-bf28-c9f271a3264c","Type":"ContainerStarted","Data":"fc9703a7aef64a5806b8d2eda979c7c27e938abbe9b862ea28367745d1814a6e"}
Jul 16 17:44:31.484218 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:31.483865    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"
Jul 16 17:44:31.504569 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:31.504524    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b" podStartSLOduration=1.24785964 podStartE2EDuration="3.50451005s" totalImagesPullingTime="2.25665041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:31.502847722 +0000 UTC m=+580.139049707" watchObservedRunningTime="2026-07-16 17:44:31.50451005 +0000 UTC m=+580.140712018"
Jul 16 17:44:32.638978 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.638936    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"]
Jul 16 17:44:32.641604 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.641580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:32.644456 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.644435    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ncxnw\""
Jul 16 17:44:32.655360 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.655339    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"]
Jul 16 17:44:32.774544 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.774512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgj4g\" (UniqueName: \"kubernetes.io/projected/89fb2699-5d5c-46d5-9a88-bd77f15ea502-kube-api-access-zgj4g\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd\" (UID: \"89fb2699-5d5c-46d5-9a88-bd77f15ea502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:32.774722 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.774576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fb2699-5d5c-46d5-9a88-bd77f15ea502-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd\" (UID: \"89fb2699-5d5c-46d5-9a88-bd77f15ea502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:32.875858 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.875813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgj4g\" (UniqueName: \"kubernetes.io/projected/89fb2699-5d5c-46d5-9a88-bd77f15ea502-kube-api-access-zgj4g\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd\" (UID: \"89fb2699-5d5c-46d5-9a88-bd77f15ea502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:32.876057 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.875881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fb2699-5d5c-46d5-9a88-bd77f15ea502-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd\" (UID: \"89fb2699-5d5c-46d5-9a88-bd77f15ea502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:32.876222 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.876205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fb2699-5d5c-46d5-9a88-bd77f15ea502-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd\" (UID: \"89fb2699-5d5c-46d5-9a88-bd77f15ea502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:32.887543 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.887521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgj4g\" (UniqueName: \"kubernetes.io/projected/89fb2699-5d5c-46d5-9a88-bd77f15ea502-kube-api-access-zgj4g\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd\" (UID: \"89fb2699-5d5c-46d5-9a88-bd77f15ea502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:32.951774 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:32.951701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:33.097932 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:33.097904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"]
Jul 16 17:44:33.098810 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:44:33.098780    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fb2699_5d5c_46d5_9a88_bd77f15ea502.slice/crio-de147f4b255e0fc72520689f0dd7e491ef119c3069024c9dcc8785b6eeef92e5 WatchSource:0}: Error finding container de147f4b255e0fc72520689f0dd7e491ef119c3069024c9dcc8785b6eeef92e5: Status 404 returned error can't find the container with id de147f4b255e0fc72520689f0dd7e491ef119c3069024c9dcc8785b6eeef92e5
Jul 16 17:44:33.494524 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:33.494487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd" event={"ID":"89fb2699-5d5c-46d5-9a88-bd77f15ea502","Type":"ContainerStarted","Data":"de147f4b255e0fc72520689f0dd7e491ef119c3069024c9dcc8785b6eeef92e5"}
Jul 16 17:44:35.294774 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.294728    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-5q86f"]
Jul 16 17:44:35.304933 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.304897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-5q86f"
Jul 16 17:44:35.311414 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.311379    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tr9j7\""
Jul 16 17:44:35.313534 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.313506    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-5q86f"]
Jul 16 17:44:35.401985 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.401951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpjx\" (UniqueName: \"kubernetes.io/projected/d302cd44-942f-4af5-a463-48cd2f54b55c-kube-api-access-dtpjx\") pod \"authorino-operator-6d85f6564-5q86f\" (UID: \"d302cd44-942f-4af5-a463-48cd2f54b55c\") " pod="kuadrant-system/authorino-operator-6d85f6564-5q86f"
Jul 16 17:44:35.502605 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.502555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpjx\" (UniqueName: \"kubernetes.io/projected/d302cd44-942f-4af5-a463-48cd2f54b55c-kube-api-access-dtpjx\") pod \"authorino-operator-6d85f6564-5q86f\" (UID: \"d302cd44-942f-4af5-a463-48cd2f54b55c\") " pod="kuadrant-system/authorino-operator-6d85f6564-5q86f"
Jul 16 17:44:35.514659 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.514631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpjx\" (UniqueName: \"kubernetes.io/projected/d302cd44-942f-4af5-a463-48cd2f54b55c-kube-api-access-dtpjx\") pod \"authorino-operator-6d85f6564-5q86f\" (UID: \"d302cd44-942f-4af5-a463-48cd2f54b55c\") " pod="kuadrant-system/authorino-operator-6d85f6564-5q86f"
Jul 16 17:44:35.622913 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.622880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-5q86f"
Jul 16 17:44:35.797529 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:35.797497    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-5q86f"]
Jul 16 17:44:35.800720 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:44:35.800673    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd302cd44_942f_4af5_a463_48cd2f54b55c.slice/crio-9ef525496148a768c1b342ba296c9599314a9773c1c388f429f200c4c7d99c57 WatchSource:0}: Error finding container 9ef525496148a768c1b342ba296c9599314a9773c1c388f429f200c4c7d99c57: Status 404 returned error can't find the container with id 9ef525496148a768c1b342ba296c9599314a9773c1c388f429f200c4c7d99c57
Jul 16 17:44:36.514965 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:36.514926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-5q86f" event={"ID":"d302cd44-942f-4af5-a463-48cd2f54b55c","Type":"ContainerStarted","Data":"9ef525496148a768c1b342ba296c9599314a9773c1c388f429f200c4c7d99c57"}
Jul 16 17:44:37.522742 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:37.522672    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd" event={"ID":"89fb2699-5d5c-46d5-9a88-bd77f15ea502","Type":"ContainerStarted","Data":"cf7ea9f9327a93c9c7bce8189b31a033210efca498b4605b1344a7ee5cedc29e"}
Jul 16 17:44:37.523167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:37.522759    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:37.551864 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:37.551812    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd" podStartSLOduration=1.257778467 podStartE2EDuration="5.551795162s" totalImagesPullingTime="4.294016695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:37.548082204 +0000 UTC m=+586.184284172" watchObservedRunningTime="2026-07-16 17:44:37.551795162 +0000 UTC m=+586.187997133"
Jul 16 17:44:38.529666 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:38.529582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-5q86f" event={"ID":"d302cd44-942f-4af5-a463-48cd2f54b55c","Type":"ContainerStarted","Data":"25afe0c5c6f7abb8117c6dc3243674d0efd9282fbee49056672154197495b3d9"}
Jul 16 17:44:38.530159 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:38.529984    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-5q86f"
Jul 16 17:44:38.558880 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:38.558815    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-5q86f" podStartSLOduration=1.2963894009999999 podStartE2EDuration="3.558795783s" totalImagesPullingTime="2.262406382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:38.556823088 +0000 UTC m=+587.193025056" watchObservedRunningTime="2026-07-16 17:44:38.558795783 +0000 UTC m=+587.194997752"
Jul 16 17:44:42.491384 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:42.491350    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b"
Jul 16 17:44:48.532451 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:48.532414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd"
Jul 16 17:44:49.536276 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:49.536246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-5q86f"
Jul 16 17:44:51.897313 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:51.897264    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:44:51.897775 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:51.897756    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:44:51.901481 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:51.901461    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:44:51.902376 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:44:51.902349    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:45:22.156926 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.156841    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-xfp6q"]
Jul 16 17:45:22.159570 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.159548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.161997 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.161973    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 17:45:22.162128 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.162071    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-68tkn\""
Jul 16 17:45:22.173888 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.173864    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-xfp6q"]
Jul 16 17:45:22.190422 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.190393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pb8j\" (UniqueName: \"kubernetes.io/projected/7032cbbf-e1fc-4e8a-8a48-356be48e692d-kube-api-access-9pb8j\") pod \"limitador-limitador-69574b596d-xfp6q\" (UID: \"7032cbbf-e1fc-4e8a-8a48-356be48e692d\") " pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.190575 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.190554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7032cbbf-e1fc-4e8a-8a48-356be48e692d-config-file\") pod \"limitador-limitador-69574b596d-xfp6q\" (UID: \"7032cbbf-e1fc-4e8a-8a48-356be48e692d\") " pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.269598 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.269567    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-xfp6q"]
Jul 16 17:45:22.291189 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.291163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7032cbbf-e1fc-4e8a-8a48-356be48e692d-config-file\") pod \"limitador-limitador-69574b596d-xfp6q\" (UID: \"7032cbbf-e1fc-4e8a-8a48-356be48e692d\") " pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.291303 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.291206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pb8j\" (UniqueName: \"kubernetes.io/projected/7032cbbf-e1fc-4e8a-8a48-356be48e692d-kube-api-access-9pb8j\") pod \"limitador-limitador-69574b596d-xfp6q\" (UID: \"7032cbbf-e1fc-4e8a-8a48-356be48e692d\") " pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.291992 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.291970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7032cbbf-e1fc-4e8a-8a48-356be48e692d-config-file\") pod \"limitador-limitador-69574b596d-xfp6q\" (UID: \"7032cbbf-e1fc-4e8a-8a48-356be48e692d\") " pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.310086 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.310063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pb8j\" (UniqueName: \"kubernetes.io/projected/7032cbbf-e1fc-4e8a-8a48-356be48e692d-kube-api-access-9pb8j\") pod \"limitador-limitador-69574b596d-xfp6q\" (UID: \"7032cbbf-e1fc-4e8a-8a48-356be48e692d\") " pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.470671 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.470583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:22.602338 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.602311    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-xfp6q"]
Jul 16 17:45:22.604617 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:45:22.604581    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7032cbbf_e1fc_4e8a_8a48_356be48e692d.slice/crio-85027e7e4862801aa14d2392e4a7cce568b7eba52afbdd56bbdcec03f0ddc671 WatchSource:0}: Error finding container 85027e7e4862801aa14d2392e4a7cce568b7eba52afbdd56bbdcec03f0ddc671: Status 404 returned error can't find the container with id 85027e7e4862801aa14d2392e4a7cce568b7eba52afbdd56bbdcec03f0ddc671
Jul 16 17:45:22.728664 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:22.728579    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q" event={"ID":"7032cbbf-e1fc-4e8a-8a48-356be48e692d","Type":"ContainerStarted","Data":"85027e7e4862801aa14d2392e4a7cce568b7eba52afbdd56bbdcec03f0ddc671"}
Jul 16 17:45:26.750291 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:26.750238    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q" event={"ID":"7032cbbf-e1fc-4e8a-8a48-356be48e692d","Type":"ContainerStarted","Data":"432697a86a08d32b41332cbaf871526ef0b970a0ea8126710398f8bce2a2e807"}
Jul 16 17:45:26.750647 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:26.750315    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:26.771443 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:26.771101    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q" podStartSLOduration=1.308200184 podStartE2EDuration="4.771080435s" totalImagesPullingTime="3.462880251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:26.770972426 +0000 UTC m=+635.407174394" watchObservedRunningTime="2026-07-16 17:45:26.771080435 +0000 UTC m=+635.407282403"
Jul 16 17:45:37.755759 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:37.755714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-xfp6q"
Jul 16 17:45:54.443539 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.443504    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-ss7x8"]
Jul 16 17:45:54.443952 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.443690    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8" podUID="d165700b-e9b0-4994-9c1f-6a1d68a934d5" containerName="manager" containerID="cri-o://8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b" gracePeriod=10
Jul 16 17:45:54.472384 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.472353    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-pddx2"]
Jul 16 17:45:54.474988 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.474971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.486096 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.486075    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-pddx2"]
Jul 16 17:45:54.573898 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.573865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb94f\" (UniqueName: \"kubernetes.io/projected/221970bb-2c5a-436a-9ab7-ecd49a5d3a74-kube-api-access-pb94f\") pod \"kserve-controller-manager-576d7b7757-pddx2\" (UID: \"221970bb-2c5a-436a-9ab7-ecd49a5d3a74\") " pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.574040 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.573968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221970bb-2c5a-436a-9ab7-ecd49a5d3a74-cert\") pod \"kserve-controller-manager-576d7b7757-pddx2\" (UID: \"221970bb-2c5a-436a-9ab7-ecd49a5d3a74\") " pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.675227 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.675196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb94f\" (UniqueName: \"kubernetes.io/projected/221970bb-2c5a-436a-9ab7-ecd49a5d3a74-kube-api-access-pb94f\") pod \"kserve-controller-manager-576d7b7757-pddx2\" (UID: \"221970bb-2c5a-436a-9ab7-ecd49a5d3a74\") " pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.675364 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.675319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221970bb-2c5a-436a-9ab7-ecd49a5d3a74-cert\") pod \"kserve-controller-manager-576d7b7757-pddx2\" (UID: \"221970bb-2c5a-436a-9ab7-ecd49a5d3a74\") " pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.677665 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.677638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/221970bb-2c5a-436a-9ab7-ecd49a5d3a74-cert\") pod \"kserve-controller-manager-576d7b7757-pddx2\" (UID: \"221970bb-2c5a-436a-9ab7-ecd49a5d3a74\") " pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.684907 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.684879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb94f\" (UniqueName: \"kubernetes.io/projected/221970bb-2c5a-436a-9ab7-ecd49a5d3a74-kube-api-access-pb94f\") pod \"kserve-controller-manager-576d7b7757-pddx2\" (UID: \"221970bb-2c5a-436a-9ab7-ecd49a5d3a74\") " pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.698866 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.698812    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:45:54.819461 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.819426    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:54.877664 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.877636    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw4rm\" (UniqueName: \"kubernetes.io/projected/d165700b-e9b0-4994-9c1f-6a1d68a934d5-kube-api-access-lw4rm\") pod \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") "
Jul 16 17:45:54.877814 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.877716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d165700b-e9b0-4994-9c1f-6a1d68a934d5-cert\") pod \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\" (UID: \"d165700b-e9b0-4994-9c1f-6a1d68a934d5\") "
Jul 16 17:45:54.880608 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.880575    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d165700b-e9b0-4994-9c1f-6a1d68a934d5-cert" (OuterVolumeSpecName: "cert") pod "d165700b-e9b0-4994-9c1f-6a1d68a934d5" (UID: "d165700b-e9b0-4994-9c1f-6a1d68a934d5"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:45:54.880736 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.880618    2580 generic.go:356] "Generic (PLEG): container finished" podID="d165700b-e9b0-4994-9c1f-6a1d68a934d5" containerID="8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b" exitCode=0
Jul 16 17:45:54.880736 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.880666    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8"
Jul 16 17:45:54.880736 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.880695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8" event={"ID":"d165700b-e9b0-4994-9c1f-6a1d68a934d5","Type":"ContainerDied","Data":"8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b"}
Jul 16 17:45:54.880880 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.880745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-576d7b7757-ss7x8" event={"ID":"d165700b-e9b0-4994-9c1f-6a1d68a934d5","Type":"ContainerDied","Data":"35d472f1d913f3802faa31234188ad001f42f99ad90a67fa554236a00f7c0db9"}
Jul 16 17:45:54.880880 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.880767    2580 scope.go:117] "RemoveContainer" containerID="8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b"
Jul 16 17:45:54.880880 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.880772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d165700b-e9b0-4994-9c1f-6a1d68a934d5-kube-api-access-lw4rm" (OuterVolumeSpecName: "kube-api-access-lw4rm") pod "d165700b-e9b0-4994-9c1f-6a1d68a934d5" (UID: "d165700b-e9b0-4994-9c1f-6a1d68a934d5"). InnerVolumeSpecName "kube-api-access-lw4rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:45:54.890183 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.890152    2580 scope.go:117] "RemoveContainer" containerID="8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b"
Jul 16 17:45:54.890467 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:45:54.890448    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b\": container with ID starting with 8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b not found: ID does not exist" containerID="8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b"
Jul 16 17:45:54.890543 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.890475    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b"} err="failed to get container status \"8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b\": rpc error: code = NotFound desc = could not find container \"8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b\": container with ID starting with 8e4627f0834edff8d07d3fb696af5116f504901f8826b56657cea70a4592651b not found: ID does not exist"
Jul 16 17:45:54.950396 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.950370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-pddx2"]
Jul 16 17:45:54.952758 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:45:54.952737    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221970bb_2c5a_436a_9ab7_ecd49a5d3a74.slice/crio-fd22b49f765df0aac4041b25f948cb261e6c5d701c522ccd77bfe0d4f5880c09 WatchSource:0}: Error finding container fd22b49f765df0aac4041b25f948cb261e6c5d701c522ccd77bfe0d4f5880c09: Status 404 returned error can't find the container with id fd22b49f765df0aac4041b25f948cb261e6c5d701c522ccd77bfe0d4f5880c09
Jul 16 17:45:54.978851 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.978822    2580 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d165700b-e9b0-4994-9c1f-6a1d68a934d5-cert\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:45:54.978851 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:54.978847    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw4rm\" (UniqueName: \"kubernetes.io/projected/d165700b-e9b0-4994-9c1f-6a1d68a934d5-kube-api-access-lw4rm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:45:55.203254 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:55.203183    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-ss7x8"]
Jul 16 17:45:55.213582 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:55.213556    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-576d7b7757-ss7x8"]
Jul 16 17:45:55.888436 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:55.888403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-576d7b7757-pddx2" event={"ID":"221970bb-2c5a-436a-9ab7-ecd49a5d3a74","Type":"ContainerStarted","Data":"a9792a43a77f0039b18b04ce4c58f9e2465abc664a60c73cf6c02cbf823d28df"}
Jul 16 17:45:55.888906 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:55.888461    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-576d7b7757-pddx2" event={"ID":"221970bb-2c5a-436a-9ab7-ecd49a5d3a74","Type":"ContainerStarted","Data":"fd22b49f765df0aac4041b25f948cb261e6c5d701c522ccd77bfe0d4f5880c09"}
Jul 16 17:45:55.888906 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:55.888514    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:45:55.910817 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:55.910769    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-576d7b7757-pddx2" podStartSLOduration=1.56231894 podStartE2EDuration="1.91075152s" totalImagesPullingTime="348.43258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:55.909857218 +0000 UTC m=+664.546059187" watchObservedRunningTime="2026-07-16 17:45:55.91075152 +0000 UTC m=+664.546953489"
Jul 16 17:45:56.193750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:45:56.193675    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d165700b-e9b0-4994-9c1f-6a1d68a934d5" path="/var/lib/kubelet/pods/d165700b-e9b0-4994-9c1f-6a1d68a934d5/volumes"
Jul 16 17:46:26.897814 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:46:26.897780    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-576d7b7757-pddx2"
Jul 16 17:48:27.781693 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.781656    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"]
Jul 16 17:48:27.782153 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.782038    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d165700b-e9b0-4994-9c1f-6a1d68a934d5" containerName="manager"
Jul 16 17:48:27.782153 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.782050    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d165700b-e9b0-4994-9c1f-6a1d68a934d5" containerName="manager"
Jul 16 17:48:27.782153 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.782113    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d165700b-e9b0-4994-9c1f-6a1d68a934d5" containerName="manager"
Jul 16 17:48:27.784167 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.784151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.787904 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.787879    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 17:48:27.788079 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.787884    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 16 17:48:27.788219 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.787899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-x8k6j\""
Jul 16 17:48:27.788219 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.788010    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 17:48:27.797443 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.797421    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"]
Jul 16 17:48:27.853450 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853450 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853673 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853673 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853673 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853673 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853673 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wcks\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-kube-api-access-4wcks\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853836 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.853836 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.853736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2256ea6-e4da-4339-9983-ae734ff91b70-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954189 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wcks\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-kube-api-access-4wcks\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954189 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954463 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2256ea6-e4da-4339-9983-ae734ff91b70-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954463 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954463 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954463 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954463 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954463 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954807 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954807 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954807 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954934 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.954934 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.954844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.955268 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.955249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2256ea6-e4da-4339-9983-ae734ff91b70-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.956557 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.956532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.956697 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.956680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.963675 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.963652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:27.963854 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:27.963833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wcks\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-kube-api-access-4wcks\") pod \"router-gateway-1-openshift-default-799f46c59b-tv79z\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:28.094902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:28.094824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:28.235921 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:28.235766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"]
Jul 16 17:48:28.238096 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:48:28.238064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2256ea6_e4da_4339_9983_ae734ff91b70.slice/crio-38aa8965ce42907fc68f52a59a9be1b674e61360cf821d505a61bdfe8c96f7d4 WatchSource:0}: Error finding container 38aa8965ce42907fc68f52a59a9be1b674e61360cf821d505a61bdfe8c96f7d4: Status 404 returned error can't find the container with id 38aa8965ce42907fc68f52a59a9be1b674e61360cf821d505a61bdfe8c96f7d4
Jul 16 17:48:28.240211 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:28.240194    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:48:28.579974 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:28.579938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" event={"ID":"a2256ea6-e4da-4339-9983-ae734ff91b70","Type":"ContainerStarted","Data":"38aa8965ce42907fc68f52a59a9be1b674e61360cf821d505a61bdfe8c96f7d4"}
Jul 16 17:48:30.999554 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:30.999519    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:48:30.999812 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:30.999592    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:48:30.999812 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:30.999621    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:48:31.598719 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:31.598678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" event={"ID":"a2256ea6-e4da-4339-9983-ae734ff91b70","Type":"ContainerStarted","Data":"32088a2e2bbd9052e1d3c37c55024976eadd3a2e4de3df2d015b3306b3632fd7"}
Jul 16 17:48:31.622580 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:31.622528    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" podStartSLOduration=1.863539651 podStartE2EDuration="4.622512143s" totalImagesPullingTime="2.758972492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:48:31.621028705 +0000 UTC m=+820.257230685" watchObservedRunningTime="2026-07-16 17:48:31.622512143 +0000 UTC m=+820.258714110"
Jul 16 17:48:32.096025 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:32.095990    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:32.097586 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:32.097556    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 16 17:48:33.095422 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:33.095380    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 16 17:48:34.095493 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:34.095449    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 16 17:48:35.095471 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:35.095428    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 16 17:48:36.095253 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:36.095210    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 16 17:48:37.501031 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:37.500990    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:37.501530 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:37.501321    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:37.502356 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:37.502333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:48:52.561679 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.561646    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"]
Jul 16 17:48:52.563932 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.563913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.567238 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.567215    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 17:48:52.568148 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.568124    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 16 17:48:52.578200 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.578181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"]
Jul 16 17:48:52.668767 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.668735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.668950 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.668778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.668950 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.668821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptmqh\" (UniqueName: \"kubernetes.io/projected/49a435e7-8442-4eb4-b167-6ae178a233e9-kube-api-access-ptmqh\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.668950 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.668849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.668950 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.668875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.669105 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.668982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770170 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptmqh\" (UniqueName: \"kubernetes.io/projected/49a435e7-8442-4eb4-b167-6ae178a233e9-kube-api-access-ptmqh\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770170 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770449 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770449 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770449 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770449 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770684 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.770750 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.770718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.772551 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.772528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.772699 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.772679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.785160 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.785137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptmqh\" (UniqueName: \"kubernetes.io/projected/49a435e7-8442-4eb4-b167-6ae178a233e9-kube-api-access-ptmqh\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:52.874350 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:52.874323    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:53.016119 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:53.016088    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"]
Jul 16 17:48:53.018068 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:48:53.018039    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a435e7_8442_4eb4_b167_6ae178a233e9.slice/crio-2624694cb8eda9937cd7a383f260328f9ec7a6447d11e3e71c53c27d8b740f29 WatchSource:0}: Error finding container 2624694cb8eda9937cd7a383f260328f9ec7a6447d11e3e71c53c27d8b740f29: Status 404 returned error can't find the container with id 2624694cb8eda9937cd7a383f260328f9ec7a6447d11e3e71c53c27d8b740f29
Jul 16 17:48:53.701925 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:53.701891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" event={"ID":"49a435e7-8442-4eb4-b167-6ae178a233e9","Type":"ContainerStarted","Data":"2624694cb8eda9937cd7a383f260328f9ec7a6447d11e3e71c53c27d8b740f29"}
Jul 16 17:48:54.707541 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:54.707506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" event={"ID":"49a435e7-8442-4eb4-b167-6ae178a233e9","Type":"ContainerStarted","Data":"c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403"}
Jul 16 17:48:54.730527 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:54.730461    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" podStartSLOduration=1.70603495 podStartE2EDuration="2.73044154s" totalImagesPullingTime="1.02440659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:48:54.727439661 +0000 UTC m=+843.363641632" watchObservedRunningTime="2026-07-16 17:48:54.73044154 +0000 UTC m=+843.366643509"
Jul 16 17:48:54.875301 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:54.875247    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:48:58.573456 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:58.573421    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"]
Jul 16 17:48:58.573882 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:48:58.573640    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy" containerID="cri-o://32088a2e2bbd9052e1d3c37c55024976eadd3a2e4de3df2d015b3306b3632fd7" gracePeriod=30
Jul 16 17:49:02.875156 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:02.875115    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:49:02.888052 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:02.888023    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:49:03.753111 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.753079    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerID="32088a2e2bbd9052e1d3c37c55024976eadd3a2e4de3df2d015b3306b3632fd7" exitCode=0
Jul 16 17:49:03.753262 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.753152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" event={"ID":"a2256ea6-e4da-4339-9983-ae734ff91b70","Type":"ContainerDied","Data":"32088a2e2bbd9052e1d3c37c55024976eadd3a2e4de3df2d015b3306b3632fd7"}
Jul 16 17:49:03.766882 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.766848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:49:03.830015 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.829985    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:49:03.871226 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871198    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-envoy\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871423 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wcks\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-kube-api-access-4wcks\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871423 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871267    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-token\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871423 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2256ea6-e4da-4339-9983-ae734ff91b70-istiod-ca-cert\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871423 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-data\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871423 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871401    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-certs\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871681 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871432    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-socket\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871681 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871461    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-podinfo\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871681 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871509    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-credential-socket\") pod \"a2256ea6-e4da-4339-9983-ae734ff91b70\" (UID: \"a2256ea6-e4da-4339-9983-ae734ff91b70\") "
Jul 16 17:49:03.871837 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871736    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:03.871837 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:03.871943 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.871882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2256ea6-e4da-4339-9983-ae734ff91b70-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:49:03.872040 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.872018    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2256ea6-e4da-4339-9983-ae734ff91b70-istiod-ca-cert\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.872100 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.872049    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-data\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.872100 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.872070    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.872313 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.872266    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:03.872442 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.872326    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:03.873862 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.873833    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:03.874145 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.874129    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:49:03.874243 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.874226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-kube-api-access-4wcks" (OuterVolumeSpecName: "kube-api-access-4wcks") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "kube-api-access-4wcks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:49:03.874338 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.874262    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2256ea6-e4da-4339-9983-ae734ff91b70" (UID: "a2256ea6-e4da-4339-9983-ae734ff91b70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 17:49:03.973239 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.973209    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-workload-socket\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.973239 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.973236    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-podinfo\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.973642 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.973248    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-credential-socket\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.973642 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.973257    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-envoy\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.973642 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.973266    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wcks\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-kube-api-access-4wcks\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.973642 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.973275    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2256ea6-e4da-4339-9983-ae734ff91b70-istio-token\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:03.985344 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:03.985311    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"]
Jul 16 17:49:04.759404 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:04.759372    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"
Jul 16 17:49:04.759590 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:04.759406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z" event={"ID":"a2256ea6-e4da-4339-9983-ae734ff91b70","Type":"ContainerDied","Data":"38aa8965ce42907fc68f52a59a9be1b674e61360cf821d505a61bdfe8c96f7d4"}
Jul 16 17:49:04.759590 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:04.759468    2580 scope.go:117] "RemoveContainer" containerID="32088a2e2bbd9052e1d3c37c55024976eadd3a2e4de3df2d015b3306b3632fd7"
Jul 16 17:49:04.788384 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:04.788350    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"]
Jul 16 17:49:04.794902 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:04.794876    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z"]
Jul 16 17:49:04.881491 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:04.881455    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:04.881663 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:04.881526    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs podName:49a435e7-8442-4eb4-b167-6ae178a233e9 nodeName:}" failed. No retries permitted until 2026-07-16 17:49:05.381510434 +0000 UTC m=+854.017712379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:05.385914 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:05.385880    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:05.386329 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:05.385954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs podName:49a435e7-8442-4eb4-b167-6ae178a233e9 nodeName:}" failed. No retries permitted until 2026-07-16 17:49:06.385940283 +0000 UTC m=+855.022142229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:06.193311 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:06.193262    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" path="/var/lib/kubelet/pods/a2256ea6-e4da-4339-9983-ae734ff91b70/volumes"
Jul 16 17:49:06.393159 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:06.393125    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:06.393557 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:06.393194    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs podName:49a435e7-8442-4eb4-b167-6ae178a233e9 nodeName:}" failed. No retries permitted until 2026-07-16 17:49:08.393181266 +0000 UTC m=+857.029383211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:08.409740 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:08.409699    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:08.410118 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:08.409772    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs podName:49a435e7-8442-4eb4-b167-6ae178a233e9 nodeName:}" failed. No retries permitted until 2026-07-16 17:49:12.409759414 +0000 UTC m=+861.045961360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:12.447569 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:12.447530    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:12.447973 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:12.447611    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs podName:49a435e7-8442-4eb4-b167-6ae178a233e9 nodeName:}" failed. No retries permitted until 2026-07-16 17:49:20.4475965 +0000 UTC m=+869.083798446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:20.520720 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:20.520671    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:20.521107 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:20.520766    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs podName:49a435e7-8442-4eb4-b167-6ae178a233e9 nodeName:}" failed. No retries permitted until 2026-07-16 17:49:36.520747809 +0000 UTC m=+885.156949758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 17:49:20.784670 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:20.784581    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" podUID="49a435e7-8442-4eb4-b167-6ae178a233e9" containerName="main" containerID="cri-o://c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403" gracePeriod=45
Jul 16 17:49:21.038271 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.038211    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:49:21.125925 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.125894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-dshm\") pod \"49a435e7-8442-4eb4-b167-6ae178a233e9\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") "
Jul 16 17:49:21.126100 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.125981    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs\") pod \"49a435e7-8442-4eb4-b167-6ae178a233e9\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") "
Jul 16 17:49:21.126100 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.126016    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-home\") pod \"49a435e7-8442-4eb4-b167-6ae178a233e9\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") "
Jul 16 17:49:21.126100 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.126066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-model-cache\") pod \"49a435e7-8442-4eb4-b167-6ae178a233e9\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") "
Jul 16 17:49:21.126231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.126097    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptmqh\" (UniqueName: \"kubernetes.io/projected/49a435e7-8442-4eb4-b167-6ae178a233e9-kube-api-access-ptmqh\") pod \"49a435e7-8442-4eb4-b167-6ae178a233e9\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") "
Jul 16 17:49:21.126231 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.126123    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-tmp-dir\") pod \"49a435e7-8442-4eb4-b167-6ae178a233e9\" (UID: \"49a435e7-8442-4eb4-b167-6ae178a233e9\") "
Jul 16 17:49:21.126442 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.126409    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "49a435e7-8442-4eb4-b167-6ae178a233e9" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:21.126553 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.126422    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-home" (OuterVolumeSpecName: "home") pod "49a435e7-8442-4eb4-b167-6ae178a233e9" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:21.126553 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.126470    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "49a435e7-8442-4eb4-b167-6ae178a233e9" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:21.128226 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.128194    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "49a435e7-8442-4eb4-b167-6ae178a233e9" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:49:21.128226 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.128201    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-dshm" (OuterVolumeSpecName: "dshm") pod "49a435e7-8442-4eb4-b167-6ae178a233e9" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:49:21.128226 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.128215    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49a435e7-8442-4eb4-b167-6ae178a233e9-kube-api-access-ptmqh" (OuterVolumeSpecName: "kube-api-access-ptmqh") pod "49a435e7-8442-4eb4-b167-6ae178a233e9" (UID: "49a435e7-8442-4eb4-b167-6ae178a233e9"). InnerVolumeSpecName "kube-api-access-ptmqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:49:21.227700 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.227659    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:21.227700 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.227694    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptmqh\" (UniqueName: \"kubernetes.io/projected/49a435e7-8442-4eb4-b167-6ae178a233e9-kube-api-access-ptmqh\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:21.227700 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.227706    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:21.227938 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.227716    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:21.227938 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.227731    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49a435e7-8442-4eb4-b167-6ae178a233e9-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:21.227938 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.227740    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49a435e7-8442-4eb4-b167-6ae178a233e9-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:49:21.841450 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.841415    2580 generic.go:356] "Generic (PLEG): container finished" podID="49a435e7-8442-4eb4-b167-6ae178a233e9" containerID="c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403" exitCode=0
Jul 16 17:49:21.841900 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.841477    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"
Jul 16 17:49:21.841900 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.841491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" event={"ID":"49a435e7-8442-4eb4-b167-6ae178a233e9","Type":"ContainerDied","Data":"c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403"}
Jul 16 17:49:21.841900 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.841532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6" event={"ID":"49a435e7-8442-4eb4-b167-6ae178a233e9","Type":"ContainerDied","Data":"2624694cb8eda9937cd7a383f260328f9ec7a6447d11e3e71c53c27d8b740f29"}
Jul 16 17:49:21.841900 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.841554    2580 scope.go:117] "RemoveContainer" containerID="c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403"
Jul 16 17:49:21.851391 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.851367    2580 scope.go:117] "RemoveContainer" containerID="c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403"
Jul 16 17:49:21.851705 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:49:21.851682    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403\": container with ID starting with c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403 not found: ID does not exist" containerID="c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403"
Jul 16 17:49:21.851788 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.851716    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403"} err="failed to get container status \"c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403\": rpc error: code = NotFound desc = could not find container \"c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403\": container with ID starting with c6ecc83e77fe6853c92f90dfe17b526e67163b70bace35dcd1474e25cb79e403 not found: ID does not exist"
Jul 16 17:49:21.867882 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.867860    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"]
Jul 16 17:49:21.873661 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:21.873639    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6"]
Jul 16 17:49:22.193421 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:22.193387    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49a435e7-8442-4eb4-b167-6ae178a233e9" path="/var/lib/kubelet/pods/49a435e7-8442-4eb4-b167-6ae178a233e9/volumes"
Jul 16 17:49:51.924582 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:51.924506    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:49:51.926483 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:51.926447    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:49:51.929933 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:51.929910    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:49:51.932093 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:49:51.932072    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:51:03.001772 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.001738    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"]
Jul 16 17:51:03.004039 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.002076    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49a435e7-8442-4eb4-b167-6ae178a233e9" containerName="main"
Jul 16 17:51:03.004039 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.002087    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="49a435e7-8442-4eb4-b167-6ae178a233e9" containerName="main"
Jul 16 17:51:03.004039 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.002098    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy"
Jul 16 17:51:03.004039 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.002104    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy"
Jul 16 17:51:03.004039 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.002167    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2256ea6-e4da-4339-9983-ae734ff91b70" containerName="istio-proxy"
Jul 16 17:51:03.004039 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.002176    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="49a435e7-8442-4eb4-b167-6ae178a233e9" containerName="main"
Jul 16 17:51:03.004944 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.004928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.008439 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.008414    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 17:51:03.008570 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.008441    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 17:51:03.008570 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.008449    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jul 16 17:51:03.008570 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.008441    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 17:51:03.018462 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.018439    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"]
Jul 16 17:51:03.060939 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.060907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.061090 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.060989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89hw7\" (UniqueName: \"kubernetes.io/projected/544da22f-93a3-44ab-b0ef-98a94c20e0e0-kube-api-access-89hw7\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.061090 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.061042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.061171 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.061091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.061171 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.061120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.061171 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.061146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.162410 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.162374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.162604 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.162453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89hw7\" (UniqueName: \"kubernetes.io/projected/544da22f-93a3-44ab-b0ef-98a94c20e0e0-kube-api-access-89hw7\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.162604 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.162495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.162604 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.162523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.162604 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.162546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.162604 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.162580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.162964 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.162933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-home\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.163081 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.163060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tmp-dir\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.163203 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.163175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-model-cache\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.164720 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.164699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-dshm\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.165099 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.165081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tls-certs\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.171888 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.171865    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89hw7\" (UniqueName: \"kubernetes.io/projected/544da22f-93a3-44ab-b0ef-98a94c20e0e0-kube-api-access-89hw7\") pod \"llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") " pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.315892 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.315800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:03.453895 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:03.453874    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"]
Jul 16 17:51:03.456055 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:51:03.456014    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544da22f_93a3_44ab_b0ef_98a94c20e0e0.slice/crio-80053feaffd3f6f504f9813bf6bad38bc2cb2e0ace48c668ad322781f37ada70 WatchSource:0}: Error finding container 80053feaffd3f6f504f9813bf6bad38bc2cb2e0ace48c668ad322781f37ada70: Status 404 returned error can't find the container with id 80053feaffd3f6f504f9813bf6bad38bc2cb2e0ace48c668ad322781f37ada70
Jul 16 17:51:04.303526 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:04.303490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f" event={"ID":"544da22f-93a3-44ab-b0ef-98a94c20e0e0","Type":"ContainerStarted","Data":"ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f"}
Jul 16 17:51:04.303912 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:04.303541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f" event={"ID":"544da22f-93a3-44ab-b0ef-98a94c20e0e0","Type":"ContainerStarted","Data":"80053feaffd3f6f504f9813bf6bad38bc2cb2e0ace48c668ad322781f37ada70"}
Jul 16 17:51:04.316100 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:04.316076    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:04.325990 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:04.325947    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f" podStartSLOduration=2.325931645 podStartE2EDuration="2.325931645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:51:04.323994643 +0000 UTC m=+972.960196610" watchObservedRunningTime="2026-07-16 17:51:04.325931645 +0000 UTC m=+972.962133613"
Jul 16 17:51:13.316791 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:13.316700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:13.329304 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:13.329262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:13.359299 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:13.359251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:36.935515 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:36.935474    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"]
Jul 16 17:51:51.956444 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:51.956402    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f" podUID="544da22f-93a3-44ab-b0ef-98a94c20e0e0" containerName="main" containerID="cri-o://ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f" gracePeriod=45
Jul 16 17:51:52.203242 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.203217    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:52.276107 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tls-certs\") pod \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") "
Jul 16 17:51:52.276107 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-model-cache\") pod \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") "
Jul 16 17:51:52.276107 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276101    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89hw7\" (UniqueName: \"kubernetes.io/projected/544da22f-93a3-44ab-b0ef-98a94c20e0e0-kube-api-access-89hw7\") pod \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") "
Jul 16 17:51:52.276408 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276153    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-dshm\") pod \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") "
Jul 16 17:51:52.276408 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276174    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tmp-dir\") pod \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") "
Jul 16 17:51:52.276408 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-home\") pod \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\" (UID: \"544da22f-93a3-44ab-b0ef-98a94c20e0e0\") "
Jul 16 17:51:52.276557 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276530    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "544da22f-93a3-44ab-b0ef-98a94c20e0e0" (UID: "544da22f-93a3-44ab-b0ef-98a94c20e0e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:51:52.276610 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276548    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-model-cache" (OuterVolumeSpecName: "model-cache") pod "544da22f-93a3-44ab-b0ef-98a94c20e0e0" (UID: "544da22f-93a3-44ab-b0ef-98a94c20e0e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:51:52.276749 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.276719    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-home" (OuterVolumeSpecName: "home") pod "544da22f-93a3-44ab-b0ef-98a94c20e0e0" (UID: "544da22f-93a3-44ab-b0ef-98a94c20e0e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:51:52.278644 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.278616    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-dshm" (OuterVolumeSpecName: "dshm") pod "544da22f-93a3-44ab-b0ef-98a94c20e0e0" (UID: "544da22f-93a3-44ab-b0ef-98a94c20e0e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:51:52.278800 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.278775    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "544da22f-93a3-44ab-b0ef-98a94c20e0e0" (UID: "544da22f-93a3-44ab-b0ef-98a94c20e0e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:51:52.278873 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.278853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/544da22f-93a3-44ab-b0ef-98a94c20e0e0-kube-api-access-89hw7" (OuterVolumeSpecName: "kube-api-access-89hw7") pod "544da22f-93a3-44ab-b0ef-98a94c20e0e0" (UID: "544da22f-93a3-44ab-b0ef-98a94c20e0e0"). InnerVolumeSpecName "kube-api-access-89hw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:51:52.377798 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.377762    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89hw7\" (UniqueName: \"kubernetes.io/projected/544da22f-93a3-44ab-b0ef-98a94c20e0e0-kube-api-access-89hw7\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:51:52.377798 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.377793    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:51:52.377798 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.377803    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:51:52.378017 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.377813    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:51:52.378017 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.377820    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/544da22f-93a3-44ab-b0ef-98a94c20e0e0-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:51:52.378017 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.377828    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/544da22f-93a3-44ab-b0ef-98a94c20e0e0-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:51:52.526209 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.526120    2580 generic.go:356] "Generic (PLEG): container finished" podID="544da22f-93a3-44ab-b0ef-98a94c20e0e0" containerID="ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f" exitCode=0
Jul 16 17:51:52.526209 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.526182    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"
Jul 16 17:51:52.526421 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.526213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f" event={"ID":"544da22f-93a3-44ab-b0ef-98a94c20e0e0","Type":"ContainerDied","Data":"ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f"}
Jul 16 17:51:52.526421 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.526318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f" event={"ID":"544da22f-93a3-44ab-b0ef-98a94c20e0e0","Type":"ContainerDied","Data":"80053feaffd3f6f504f9813bf6bad38bc2cb2e0ace48c668ad322781f37ada70"}
Jul 16 17:51:52.526421 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.526343    2580 scope.go:117] "RemoveContainer" containerID="ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f"
Jul 16 17:51:52.535934 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.535916    2580 scope.go:117] "RemoveContainer" containerID="ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f"
Jul 16 17:51:52.536185 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:51:52.536164    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f\": container with ID starting with ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f not found: ID does not exist" containerID="ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f"
Jul 16 17:51:52.536232 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.536193    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f"} err="failed to get container status \"ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f\": rpc error: code = NotFound desc = could not find container \"ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f\": container with ID starting with ab35d3589fa81e0bf8a88ae9d351958246f19bf71f86f058757b180b0b30906f not found: ID does not exist"
Jul 16 17:51:52.550485 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.550458    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"]
Jul 16 17:51:52.555719 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:52.555697    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f"]
Jul 16 17:51:54.195256 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:51:54.195215    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="544da22f-93a3-44ab-b0ef-98a94c20e0e0" path="/var/lib/kubelet/pods/544da22f-93a3-44ab-b0ef-98a94c20e0e0/volumes"
Jul 16 17:53:02.223467 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.223431    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"]
Jul 16 17:53:02.223912 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.223786    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="544da22f-93a3-44ab-b0ef-98a94c20e0e0" containerName="main"
Jul 16 17:53:02.223912 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.223800    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="544da22f-93a3-44ab-b0ef-98a94c20e0e0" containerName="main"
Jul 16 17:53:02.223912 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.223873    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="544da22f-93a3-44ab-b0ef-98a94c20e0e0" containerName="main"
Jul 16 17:53:02.227969 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.227951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.233390 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.233342    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 17:53:02.233390 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.233370    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 17:53:02.233562 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.233388    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 17:53:02.233562 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.233372    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Jul 16 17:53:02.239332 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.239306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"]
Jul 16 17:53:02.374547 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.374516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.374732 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.374554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071a1956-4959-4719-ac48-efb61f1cf7ea-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.374732 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.374623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.374732 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.374674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmrz\" (UniqueName: \"kubernetes.io/projected/071a1956-4959-4719-ac48-efb61f1cf7ea-kube-api-access-6pmrz\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.374732 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.374705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.374732 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.374726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.475720 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.475631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.475720 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.475689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmrz\" (UniqueName: \"kubernetes.io/projected/071a1956-4959-4719-ac48-efb61f1cf7ea-kube-api-access-6pmrz\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.475982 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.475735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.475982 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.475764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.475982 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.475827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.475982 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.475862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071a1956-4959-4719-ac48-efb61f1cf7ea-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.476218 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.476095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.476218 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.476115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.476218 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.476201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.477995 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.477975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.478295 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.478262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071a1956-4959-4719-ac48-efb61f1cf7ea-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.486252 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.486230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmrz\" (UniqueName: \"kubernetes.io/projected/071a1956-4959-4719-ac48-efb61f1cf7ea-kube-api-access-6pmrz\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.538141 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.538104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:02.687966 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.687935    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"]
Jul 16 17:53:02.691093 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:53:02.691066    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071a1956_4959_4719_ac48_efb61f1cf7ea.slice/crio-3c6ddc42607ae8d2c0f58b3abbaf2e46c55b880a716833f33bbfe26e2abcd151 WatchSource:0}: Error finding container 3c6ddc42607ae8d2c0f58b3abbaf2e46c55b880a716833f33bbfe26e2abcd151: Status 404 returned error can't find the container with id 3c6ddc42607ae8d2c0f58b3abbaf2e46c55b880a716833f33bbfe26e2abcd151
Jul 16 17:53:02.845613 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.845580    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q" event={"ID":"071a1956-4959-4719-ac48-efb61f1cf7ea","Type":"ContainerStarted","Data":"e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f"}
Jul 16 17:53:02.845803 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.845636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q" event={"ID":"071a1956-4959-4719-ac48-efb61f1cf7ea","Type":"ContainerStarted","Data":"3c6ddc42607ae8d2c0f58b3abbaf2e46c55b880a716833f33bbfe26e2abcd151"}
Jul 16 17:53:02.871322 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:02.871253    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q" podStartSLOduration=0.871236099 podStartE2EDuration="871.236099ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:53:02.870055616 +0000 UTC m=+1091.506257585" watchObservedRunningTime="2026-07-16 17:53:02.871236099 +0000 UTC m=+1091.507438067"
Jul 16 17:53:03.538365 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:03.538330    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:12.538863 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:12.538817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:12.551206 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:12.551179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:12.904515 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:12.904485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:36.041961 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:36.041927    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"]
Jul 16 17:53:51.062940 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.062892    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q" podUID="071a1956-4959-4719-ac48-efb61f1cf7ea" containerName="main" containerID="cri-o://e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f" gracePeriod=45
Jul 16 17:53:51.310687 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.310653    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:51.385032 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-model-cache\") pod \"071a1956-4959-4719-ac48-efb61f1cf7ea\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") "
Jul 16 17:53:51.385207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-dshm\") pod \"071a1956-4959-4719-ac48-efb61f1cf7ea\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") "
Jul 16 17:53:51.385207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071a1956-4959-4719-ac48-efb61f1cf7ea-tls-certs\") pod \"071a1956-4959-4719-ac48-efb61f1cf7ea\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") "
Jul 16 17:53:51.385207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-tmp-dir\") pod \"071a1956-4959-4719-ac48-efb61f1cf7ea\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") "
Jul 16 17:53:51.385207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-home\") pod \"071a1956-4959-4719-ac48-efb61f1cf7ea\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") "
Jul 16 17:53:51.385207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pmrz\" (UniqueName: \"kubernetes.io/projected/071a1956-4959-4719-ac48-efb61f1cf7ea-kube-api-access-6pmrz\") pod \"071a1956-4959-4719-ac48-efb61f1cf7ea\" (UID: \"071a1956-4959-4719-ac48-efb61f1cf7ea\") "
Jul 16 17:53:51.385503 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "071a1956-4959-4719-ac48-efb61f1cf7ea" (UID: "071a1956-4959-4719-ac48-efb61f1cf7ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:53:51.385503 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385375    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "071a1956-4959-4719-ac48-efb61f1cf7ea" (UID: "071a1956-4959-4719-ac48-efb61f1cf7ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:53:51.385503 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385455    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-home" (OuterVolumeSpecName: "home") pod "071a1956-4959-4719-ac48-efb61f1cf7ea" (UID: "071a1956-4959-4719-ac48-efb61f1cf7ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:53:51.385663 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385520    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:53:51.385663 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.385539    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:53:51.387205 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.387183    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-dshm" (OuterVolumeSpecName: "dshm") pod "071a1956-4959-4719-ac48-efb61f1cf7ea" (UID: "071a1956-4959-4719-ac48-efb61f1cf7ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:53:51.387306 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.387254    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/071a1956-4959-4719-ac48-efb61f1cf7ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "071a1956-4959-4719-ac48-efb61f1cf7ea" (UID: "071a1956-4959-4719-ac48-efb61f1cf7ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:53:51.387373 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.387320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/071a1956-4959-4719-ac48-efb61f1cf7ea-kube-api-access-6pmrz" (OuterVolumeSpecName: "kube-api-access-6pmrz") pod "071a1956-4959-4719-ac48-efb61f1cf7ea" (UID: "071a1956-4959-4719-ac48-efb61f1cf7ea"). InnerVolumeSpecName "kube-api-access-6pmrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:53:51.486892 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.486854    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:53:51.486892 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.486882    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/071a1956-4959-4719-ac48-efb61f1cf7ea-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:53:51.486892 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.486896    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/071a1956-4959-4719-ac48-efb61f1cf7ea-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:53:51.487106 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:51.486907    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pmrz\" (UniqueName: \"kubernetes.io/projected/071a1956-4959-4719-ac48-efb61f1cf7ea-kube-api-access-6pmrz\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:53:52.073753 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.073718    2580 generic.go:356] "Generic (PLEG): container finished" podID="071a1956-4959-4719-ac48-efb61f1cf7ea" containerID="e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f" exitCode=0
Jul 16 17:53:52.074177 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.073763    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"
Jul 16 17:53:52.074177 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.073780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q" event={"ID":"071a1956-4959-4719-ac48-efb61f1cf7ea","Type":"ContainerDied","Data":"e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f"}
Jul 16 17:53:52.074177 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.073821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q" event={"ID":"071a1956-4959-4719-ac48-efb61f1cf7ea","Type":"ContainerDied","Data":"3c6ddc42607ae8d2c0f58b3abbaf2e46c55b880a716833f33bbfe26e2abcd151"}
Jul 16 17:53:52.074177 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.073842    2580 scope.go:117] "RemoveContainer" containerID="e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f"
Jul 16 17:53:52.082845 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.082827    2580 scope.go:117] "RemoveContainer" containerID="e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f"
Jul 16 17:53:52.083083 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:53:52.083066    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f\": container with ID starting with e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f not found: ID does not exist" containerID="e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f"
Jul 16 17:53:52.083128 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.083091    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f"} err="failed to get container status \"e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f\": rpc error: code = NotFound desc = could not find container \"e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f\": container with ID starting with e307a5b501394ba9b0890194ad66ad0dcda997e8eeacbf3b2f46e9387585a82f not found: ID does not exist"
Jul 16 17:53:52.100720 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.100696    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"]
Jul 16 17:53:52.106021 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.105997    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q"]
Jul 16 17:53:52.193515 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:53:52.193483    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="071a1956-4959-4719-ac48-efb61f1cf7ea" path="/var/lib/kubelet/pods/071a1956-4959-4719-ac48-efb61f1cf7ea/volumes"
Jul 16 17:54:51.958577 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:54:51.958535    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:54:51.962053 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:54:51.962031    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:54:51.962973 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:54:51.962957    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:54:51.966338 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:54:51.966320    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:56:02.685784 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.685747    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"]
Jul 16 17:56:02.686235 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.686134    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="071a1956-4959-4719-ac48-efb61f1cf7ea" containerName="main"
Jul 16 17:56:02.686235 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.686145    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="071a1956-4959-4719-ac48-efb61f1cf7ea" containerName="main"
Jul 16 17:56:02.686235 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.686209    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="071a1956-4959-4719-ac48-efb61f1cf7ea" containerName="main"
Jul 16 17:56:02.689252 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.689235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.693211 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.693184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 17:56:02.694008 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.693988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 17:56:02.694112 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.694032    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 17:56:02.694112 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.694064    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Jul 16 17:56:02.702030 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.702005    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"]
Jul 16 17:56:02.776971 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.776932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.776971 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.776970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63647fbf-cbf1-4531-9930-788bfc76a460-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.777173 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.776996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.777173 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.777100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nr2f\" (UniqueName: \"kubernetes.io/projected/63647fbf-cbf1-4531-9930-788bfc76a460-kube-api-access-5nr2f\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.777173 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.777152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.777272 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.777175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.877603 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.877566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.877603 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.877603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63647fbf-cbf1-4531-9930-788bfc76a460-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.877831 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.877632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.877831 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.877686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nr2f\" (UniqueName: \"kubernetes.io/projected/63647fbf-cbf1-4531-9930-788bfc76a460-kube-api-access-5nr2f\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.877831 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.877737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.877831 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.877765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.878035 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.878007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.878149 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.878122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.878266 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.878180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.880020 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.879997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.880123 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.880105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63647fbf-cbf1-4531-9930-788bfc76a460-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.888058 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.888035    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nr2f\" (UniqueName: \"kubernetes.io/projected/63647fbf-cbf1-4531-9930-788bfc76a460-kube-api-access-5nr2f\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:02.999653 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:02.999581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:03.134709 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:03.134682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"]
Jul 16 17:56:03.136770 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:56:03.136734    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63647fbf_cbf1_4531_9930_788bfc76a460.slice/crio-bb25e4dc7f58a3d33b2c01bcee6a51d92bd3ca353201e021be8d9afc380b0732 WatchSource:0}: Error finding container bb25e4dc7f58a3d33b2c01bcee6a51d92bd3ca353201e021be8d9afc380b0732: Status 404 returned error can't find the container with id bb25e4dc7f58a3d33b2c01bcee6a51d92bd3ca353201e021be8d9afc380b0732
Jul 16 17:56:03.680151 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:03.680111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd" event={"ID":"63647fbf-cbf1-4531-9930-788bfc76a460","Type":"ContainerStarted","Data":"ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5"}
Jul 16 17:56:03.680334 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:03.680175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd" event={"ID":"63647fbf-cbf1-4531-9930-788bfc76a460","Type":"ContainerStarted","Data":"bb25e4dc7f58a3d33b2c01bcee6a51d92bd3ca353201e021be8d9afc380b0732"}
Jul 16 17:56:03.704263 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:03.704211    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd" podStartSLOduration=1.704195237 podStartE2EDuration="1.704195237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:56:03.703341924 +0000 UTC m=+1272.339543892" watchObservedRunningTime="2026-07-16 17:56:03.704195237 +0000 UTC m=+1272.340397206"
Jul 16 17:56:04.000601 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:04.000506    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:13.000365 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:13.000325    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:13.012919 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:13.012885    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:13.738814 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:13.738784    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:36.983256 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:36.983225    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"]
Jul 16 17:56:52.003367 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.003326    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd" podUID="63647fbf-cbf1-4531-9930-788bfc76a460" containerName="main" containerID="cri-o://ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5" gracePeriod=45
Jul 16 17:56:52.254600 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.254543    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:52.417892 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.417859    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-dshm\") pod \"63647fbf-cbf1-4531-9930-788bfc76a460\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") "
Jul 16 17:56:52.418056 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.417928    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nr2f\" (UniqueName: \"kubernetes.io/projected/63647fbf-cbf1-4531-9930-788bfc76a460-kube-api-access-5nr2f\") pod \"63647fbf-cbf1-4531-9930-788bfc76a460\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") "
Jul 16 17:56:52.418056 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.417967    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-tmp-dir\") pod \"63647fbf-cbf1-4531-9930-788bfc76a460\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") "
Jul 16 17:56:52.418056 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.417986    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-home\") pod \"63647fbf-cbf1-4531-9930-788bfc76a460\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") "
Jul 16 17:56:52.418056 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.418015    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63647fbf-cbf1-4531-9930-788bfc76a460-tls-certs\") pod \"63647fbf-cbf1-4531-9930-788bfc76a460\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") "
Jul 16 17:56:52.418305 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.418115    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-model-cache\") pod \"63647fbf-cbf1-4531-9930-788bfc76a460\" (UID: \"63647fbf-cbf1-4531-9930-788bfc76a460\") "
Jul 16 17:56:52.418305 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.418260    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-home" (OuterVolumeSpecName: "home") pod "63647fbf-cbf1-4531-9930-788bfc76a460" (UID: "63647fbf-cbf1-4531-9930-788bfc76a460"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:56:52.418429 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.418272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63647fbf-cbf1-4531-9930-788bfc76a460" (UID: "63647fbf-cbf1-4531-9930-788bfc76a460"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:56:52.418490 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.418430    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-model-cache" (OuterVolumeSpecName: "model-cache") pod "63647fbf-cbf1-4531-9930-788bfc76a460" (UID: "63647fbf-cbf1-4531-9930-788bfc76a460"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:56:52.418490 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.418462    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:56:52.418490 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.418479    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:56:52.420024 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.420003    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63647fbf-cbf1-4531-9930-788bfc76a460-kube-api-access-5nr2f" (OuterVolumeSpecName: "kube-api-access-5nr2f") pod "63647fbf-cbf1-4531-9930-788bfc76a460" (UID: "63647fbf-cbf1-4531-9930-788bfc76a460"). InnerVolumeSpecName "kube-api-access-5nr2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:56:52.420468 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.420446    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63647fbf-cbf1-4531-9930-788bfc76a460-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63647fbf-cbf1-4531-9930-788bfc76a460" (UID: "63647fbf-cbf1-4531-9930-788bfc76a460"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:56:52.420547 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.420446    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-dshm" (OuterVolumeSpecName: "dshm") pod "63647fbf-cbf1-4531-9930-788bfc76a460" (UID: "63647fbf-cbf1-4531-9930-788bfc76a460"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:56:52.518856 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.518775    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63647fbf-cbf1-4531-9930-788bfc76a460-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:56:52.518856 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.518810    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:56:52.518856 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.518818    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63647fbf-cbf1-4531-9930-788bfc76a460-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:56:52.518856 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.518826    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nr2f\" (UniqueName: \"kubernetes.io/projected/63647fbf-cbf1-4531-9930-788bfc76a460-kube-api-access-5nr2f\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:56:52.911394 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.911359    2580 generic.go:356] "Generic (PLEG): container finished" podID="63647fbf-cbf1-4531-9930-788bfc76a460" containerID="ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5" exitCode=0
Jul 16 17:56:52.911560 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.911423    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"
Jul 16 17:56:52.911560 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.911425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd" event={"ID":"63647fbf-cbf1-4531-9930-788bfc76a460","Type":"ContainerDied","Data":"ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5"}
Jul 16 17:56:52.911560 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.911511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd" event={"ID":"63647fbf-cbf1-4531-9930-788bfc76a460","Type":"ContainerDied","Data":"bb25e4dc7f58a3d33b2c01bcee6a51d92bd3ca353201e021be8d9afc380b0732"}
Jul 16 17:56:52.911560 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.911533    2580 scope.go:117] "RemoveContainer" containerID="ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5"
Jul 16 17:56:52.920433 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.920418    2580 scope.go:117] "RemoveContainer" containerID="ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5"
Jul 16 17:56:52.920681 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:56:52.920663    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5\": container with ID starting with ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5 not found: ID does not exist" containerID="ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5"
Jul 16 17:56:52.920742 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.920693    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5"} err="failed to get container status \"ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5\": rpc error: code = NotFound desc = could not find container \"ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5\": container with ID starting with ed7f5ba074504bb35b65aa4c804125f85e725a2e0b67d7e1e0933bc212b45af5 not found: ID does not exist"
Jul 16 17:56:52.935491 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.935465    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"]
Jul 16 17:56:52.940981 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:52.940961    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd"]
Jul 16 17:56:54.193466 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:56:54.193430    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63647fbf-cbf1-4531-9930-788bfc76a460" path="/var/lib/kubelet/pods/63647fbf-cbf1-4531-9930-788bfc76a460/volumes"
Jul 16 17:57:47.038086 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.038048    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"]
Jul 16 17:57:47.038530 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.038448    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63647fbf-cbf1-4531-9930-788bfc76a460" containerName="main"
Jul 16 17:57:47.038530 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.038461    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63647fbf-cbf1-4531-9930-788bfc76a460" containerName="main"
Jul 16 17:57:47.038530 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.038521    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63647fbf-cbf1-4531-9930-788bfc76a460" containerName="main"
Jul 16 17:57:47.041604 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.041584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.045482 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.045462    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 16 17:57:47.045829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.045815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-x8k6j\""
Jul 16 17:57:47.046024 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.046008    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 17:57:47.046829 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.046813    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 17:57:47.058971 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.058947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"]
Jul 16 17:57:47.185782 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.185738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.185782 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.185780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.186045 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.185882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.186045 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.185934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d79165-0e41-4c63-af6c-dd547a7455e9-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.186045 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.185967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.186045 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.186009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.186199 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.186057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.186199 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.186082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q8pf\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-kube-api-access-4q8pf\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.186199 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.186143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287206 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287206 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q8pf\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-kube-api-access-4q8pf\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287502 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287502 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287502 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287502 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287502 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d79165-0e41-4c63-af6c-dd547a7455e9-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287502 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287502 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287857 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287857 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287857 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.287994 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.287923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.288264 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.288210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d79165-0e41-4c63-af6c-dd547a7455e9-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.289790 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.289770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.290023 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.290001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.298649 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.298617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q8pf\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-kube-api-access-4q8pf\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.300563 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.300546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-8zdl2\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.351471 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.351436    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:47.495759 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.495729    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"]
Jul 16 17:57:47.496031 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:57:47.496009    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d79165_0e41_4c63_af6c_dd547a7455e9.slice/crio-116142b8b8cd99777271e8f140723b02c9c1037072e6d665e13bf0d112ae3648 WatchSource:0}: Error finding container 116142b8b8cd99777271e8f140723b02c9c1037072e6d665e13bf0d112ae3648: Status 404 returned error can't find the container with id 116142b8b8cd99777271e8f140723b02c9c1037072e6d665e13bf0d112ae3648
Jul 16 17:57:47.498148 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.498113    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:57:47.498228 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.498196    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:57:47.498269 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.498228    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:57:47.824978 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:47.824891    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"]
Jul 16 17:57:48.168590 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:48.168549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2" event={"ID":"b6d79165-0e41-4c63-af6c-dd547a7455e9","Type":"ContainerStarted","Data":"45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639"}
Jul 16 17:57:48.168962 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:48.168614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2" event={"ID":"b6d79165-0e41-4c63-af6c-dd547a7455e9","Type":"ContainerStarted","Data":"116142b8b8cd99777271e8f140723b02c9c1037072e6d665e13bf0d112ae3648"}
Jul 16 17:57:48.198152 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:48.198103    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2" podStartSLOduration=1.198086207 podStartE2EDuration="1.198086207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:57:48.19514298 +0000 UTC m=+1376.831344948" watchObservedRunningTime="2026-07-16 17:57:48.198086207 +0000 UTC m=+1376.834288175"
Jul 16 17:57:48.351908 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:48.351871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:48.356799 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:48.356773    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:49.172980 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:49.172936    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2" podUID="b6d79165-0e41-4c63-af6c-dd547a7455e9" containerName="istio-proxy" containerID="cri-o://45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639" gracePeriod=30
Jul 16 17:57:49.173449 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:49.173072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:49.174084 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:49.174061    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:54.445836 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.445766    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:54.552384 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-socket\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552384 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-token\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552633 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-credential-socket\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552633 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552442    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-data\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552633 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552557    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q8pf\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-kube-api-access-4q8pf\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552633 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-certs\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552815 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-envoy\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552815 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552684    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:57:54.552815 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552728    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d79165-0e41-4c63-af6c-dd547a7455e9-istiod-ca-cert\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.552815 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552746    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:57:54.552815 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552765    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-podinfo\") pod \"b6d79165-0e41-4c63-af6c-dd547a7455e9\" (UID: \"b6d79165-0e41-4c63-af6c-dd547a7455e9\") "
Jul 16 17:57:54.553046 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.552766    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:57:54.553109 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.553038    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-socket\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.553109 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.553060    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-credential-socket\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.553109 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.553075    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-data\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.553109 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.553080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:57:54.553270 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.553152    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6d79165-0e41-4c63-af6c-dd547a7455e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:57:54.554819 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.554795    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 17:57:54.554931 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.554864    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:57:54.555080 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.555059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-kube-api-access-4q8pf" (OuterVolumeSpecName: "kube-api-access-4q8pf") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "kube-api-access-4q8pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:57:54.555256 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.555231    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6d79165-0e41-4c63-af6c-dd547a7455e9" (UID: "b6d79165-0e41-4c63-af6c-dd547a7455e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:57:54.653839 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.653803    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6d79165-0e41-4c63-af6c-dd547a7455e9-istiod-ca-cert\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.653839 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.653832    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-podinfo\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.653839 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.653842    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-token\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.654115 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.653850    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q8pf\" (UniqueName: \"kubernetes.io/projected/b6d79165-0e41-4c63-af6c-dd547a7455e9-kube-api-access-4q8pf\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.654115 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.653861    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-workload-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:54.654115 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:54.653869    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6d79165-0e41-4c63-af6c-dd547a7455e9-istio-envoy\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 17:57:55.203865 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.203817    2580 generic.go:356] "Generic (PLEG): container finished" podID="b6d79165-0e41-4c63-af6c-dd547a7455e9" containerID="45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639" exitCode=0
Jul 16 17:57:55.204037 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.203892    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"
Jul 16 17:57:55.204037 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.203903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2" event={"ID":"b6d79165-0e41-4c63-af6c-dd547a7455e9","Type":"ContainerDied","Data":"45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639"}
Jul 16 17:57:55.204037 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.203960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2" event={"ID":"b6d79165-0e41-4c63-af6c-dd547a7455e9","Type":"ContainerDied","Data":"116142b8b8cd99777271e8f140723b02c9c1037072e6d665e13bf0d112ae3648"}
Jul 16 17:57:55.204037 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.203982    2580 scope.go:117] "RemoveContainer" containerID="45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639"
Jul 16 17:57:55.213369 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.213344    2580 scope.go:117] "RemoveContainer" containerID="45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639"
Jul 16 17:57:55.213633 ip-10-0-128-180 kubenswrapper[2580]: E0716 17:57:55.213611    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639\": container with ID starting with 45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639 not found: ID does not exist" containerID="45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639"
Jul 16 17:57:55.213693 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.213641    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639"} err="failed to get container status \"45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639\": rpc error: code = NotFound desc = could not find container \"45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639\": container with ID starting with 45946372ba88bcee5d4ed32957351ed7417d7b1dab8233ca1a4e9c3315bc1639 not found: ID does not exist"
Jul 16 17:57:55.234416 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.234368    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"]
Jul 16 17:57:55.236265 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.236239    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2"]
Jul 16 17:57:55.825841 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.825806    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"]
Jul 16 17:57:55.826207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.826172    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d79165-0e41-4c63-af6c-dd547a7455e9" containerName="istio-proxy"
Jul 16 17:57:55.826207 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.826184    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d79165-0e41-4c63-af6c-dd547a7455e9" containerName="istio-proxy"
Jul 16 17:57:55.826273 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.826240    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6d79165-0e41-4c63-af6c-dd547a7455e9" containerName="istio-proxy"
Jul 16 17:57:55.830440 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.830421    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:55.845270 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.845247    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs\""
Jul 16 17:57:55.845397 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.845247    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 17:57:55.845397 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.845248    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 17:57:55.845534 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.845402    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 17:57:55.871736 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.871704    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"]
Jul 16 17:57:55.967841 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.967796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjhn\" (UniqueName: \"kubernetes.io/projected/d22c95e1-cdde-4ccd-a75b-534f11592b82-kube-api-access-dhjhn\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:55.968022 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.967865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22c95e1-cdde-4ccd-a75b-534f11592b82-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:55.968022 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.967902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:55.968022 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.967921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:55.968022 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.967945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:55.968022 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:55.967963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069058 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjhn\" (UniqueName: \"kubernetes.io/projected/d22c95e1-cdde-4ccd-a75b-534f11592b82-kube-api-access-dhjhn\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069232 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22c95e1-cdde-4ccd-a75b-534f11592b82-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069232 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069232 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069232 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069232 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069715 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069801 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.069801 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.069741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.071702 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.071681    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.071858 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.071841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22c95e1-cdde-4ccd-a75b-534f11592b82-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.083321 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.083235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjhn\" (UniqueName: \"kubernetes.io/projected/d22c95e1-cdde-4ccd-a75b-534f11592b82-kube-api-access-dhjhn\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.140430 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.140401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:57:56.198233 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.197977    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6d79165-0e41-4c63-af6c-dd547a7455e9" path="/var/lib/kubelet/pods/b6d79165-0e41-4c63-af6c-dd547a7455e9/volumes"
Jul 16 17:57:56.349239 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:56.349155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"]
Jul 16 17:57:56.355540 ip-10-0-128-180 kubenswrapper[2580]: W0716 17:57:56.355507    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22c95e1_cdde_4ccd_a75b_534f11592b82.slice/crio-f663f89e932ba426e6eb31fc340161c41c5a861fe56db05396fa4d59ed6bc005 WatchSource:0}: Error finding container f663f89e932ba426e6eb31fc340161c41c5a861fe56db05396fa4d59ed6bc005: Status 404 returned error can't find the container with id f663f89e932ba426e6eb31fc340161c41c5a861fe56db05396fa4d59ed6bc005
Jul 16 17:57:57.217919 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:57.217884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m" event={"ID":"d22c95e1-cdde-4ccd-a75b-534f11592b82","Type":"ContainerStarted","Data":"265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938"}
Jul 16 17:57:57.218300 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:57.217935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m" event={"ID":"d22c95e1-cdde-4ccd-a75b-534f11592b82","Type":"ContainerStarted","Data":"f663f89e932ba426e6eb31fc340161c41c5a861fe56db05396fa4d59ed6bc005"}
Jul 16 17:57:57.257198 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:57.257147    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m" podStartSLOduration=2.2571312040000002 podStartE2EDuration="2.257131204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:57:57.254562915 +0000 UTC m=+1385.890764887" watchObservedRunningTime="2026-07-16 17:57:57.257131204 +0000 UTC m=+1385.893333191"
Jul 16 17:57:58.140698 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:57:58.140656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:58:06.141192 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:58:06.141148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:58:06.153804 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:58:06.153775    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:58:06.277734 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:58:06.277662    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 17:59:51.985900 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:59:51.985867    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:59:51.989540 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:59:51.989518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 17:59:51.990485 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:59:51.990462    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 17:59:51.994074 ip-10-0-128-180 kubenswrapper[2580]: I0716 17:59:51.994055    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:02:56.585251 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:02:56.585207    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"]
Jul 16 18:03:11.605815 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.605756    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m" podUID="d22c95e1-cdde-4ccd-a75b-534f11592b82" containerName="main" containerID="cri-o://265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938" gracePeriod=45
Jul 16 18:03:11.861727 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.861707    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 18:03:11.928195 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-home\") pod \"d22c95e1-cdde-4ccd-a75b-534f11592b82\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") "
Jul 16 18:03:11.928396 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-model-cache\") pod \"d22c95e1-cdde-4ccd-a75b-534f11592b82\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") "
Jul 16 18:03:11.928396 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhjhn\" (UniqueName: \"kubernetes.io/projected/d22c95e1-cdde-4ccd-a75b-534f11592b82-kube-api-access-dhjhn\") pod \"d22c95e1-cdde-4ccd-a75b-534f11592b82\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") "
Jul 16 18:03:11.928396 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928318    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-tmp-dir\") pod \"d22c95e1-cdde-4ccd-a75b-534f11592b82\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") "
Jul 16 18:03:11.928396 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928343    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-dshm\") pod \"d22c95e1-cdde-4ccd-a75b-534f11592b82\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") "
Jul 16 18:03:11.928396 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22c95e1-cdde-4ccd-a75b-534f11592b82-tls-certs\") pod \"d22c95e1-cdde-4ccd-a75b-534f11592b82\" (UID: \"d22c95e1-cdde-4ccd-a75b-534f11592b82\") "
Jul 16 18:03:11.928632 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-home" (OuterVolumeSpecName: "home") pod "d22c95e1-cdde-4ccd-a75b-534f11592b82" (UID: "d22c95e1-cdde-4ccd-a75b-534f11592b82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:03:11.928632 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928506    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-model-cache" (OuterVolumeSpecName: "model-cache") pod "d22c95e1-cdde-4ccd-a75b-534f11592b82" (UID: "d22c95e1-cdde-4ccd-a75b-534f11592b82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:03:11.928632 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928597    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d22c95e1-cdde-4ccd-a75b-534f11592b82" (UID: "d22c95e1-cdde-4ccd-a75b-534f11592b82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:03:11.928756 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928657    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:03:11.928756 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.928676    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:03:11.930586 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.930557    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-dshm" (OuterVolumeSpecName: "dshm") pod "d22c95e1-cdde-4ccd-a75b-534f11592b82" (UID: "d22c95e1-cdde-4ccd-a75b-534f11592b82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:03:11.930703 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.930646    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d22c95e1-cdde-4ccd-a75b-534f11592b82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d22c95e1-cdde-4ccd-a75b-534f11592b82" (UID: "d22c95e1-cdde-4ccd-a75b-534f11592b82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:03:11.930703 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:11.930694    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22c95e1-cdde-4ccd-a75b-534f11592b82-kube-api-access-dhjhn" (OuterVolumeSpecName: "kube-api-access-dhjhn") pod "d22c95e1-cdde-4ccd-a75b-534f11592b82" (UID: "d22c95e1-cdde-4ccd-a75b-534f11592b82"). InnerVolumeSpecName "kube-api-access-dhjhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:03:12.029713 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.029683    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhjhn\" (UniqueName: \"kubernetes.io/projected/d22c95e1-cdde-4ccd-a75b-534f11592b82-kube-api-access-dhjhn\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:03:12.029713 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.029710    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:03:12.029713 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.029720    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22c95e1-cdde-4ccd-a75b-534f11592b82-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:03:12.029926 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.029729    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22c95e1-cdde-4ccd-a75b-534f11592b82-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:03:12.695667 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.695629    2580 generic.go:356] "Generic (PLEG): container finished" podID="d22c95e1-cdde-4ccd-a75b-534f11592b82" containerID="265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938" exitCode=0
Jul 16 18:03:12.696083 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.695678    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"
Jul 16 18:03:12.696083 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.695714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m" event={"ID":"d22c95e1-cdde-4ccd-a75b-534f11592b82","Type":"ContainerDied","Data":"265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938"}
Jul 16 18:03:12.696083 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.695771    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m" event={"ID":"d22c95e1-cdde-4ccd-a75b-534f11592b82","Type":"ContainerDied","Data":"f663f89e932ba426e6eb31fc340161c41c5a861fe56db05396fa4d59ed6bc005"}
Jul 16 18:03:12.696083 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.695796    2580 scope.go:117] "RemoveContainer" containerID="265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938"
Jul 16 18:03:12.704217 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.704200    2580 scope.go:117] "RemoveContainer" containerID="265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938"
Jul 16 18:03:12.704476 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:03:12.704455    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938\": container with ID starting with 265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938 not found: ID does not exist" containerID="265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938"
Jul 16 18:03:12.704547 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.704482    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938"} err="failed to get container status \"265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938\": rpc error: code = NotFound desc = could not find container \"265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938\": container with ID starting with 265ef7484812dc5cf114a6ad2ee75e0c0ef0ea30c9cc57252f93f38e15f9d938 not found: ID does not exist"
Jul 16 18:03:12.714678 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.714653    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"]
Jul 16 18:03:12.720218 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:12.720197    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m"]
Jul 16 18:03:14.193591 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:03:14.193492    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d22c95e1-cdde-4ccd-a75b-534f11592b82" path="/var/lib/kubelet/pods/d22c95e1-cdde-4ccd-a75b-534f11592b82/volumes"
Jul 16 18:04:52.012343 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:04:52.012315    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:04:52.015625 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:04:52.015602    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:04:52.016957 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:04:52.016935    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:04:52.020342 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:04:52.020326    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:09:12.733901 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.733858    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"]
Jul 16 18:09:12.734417 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.734213    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22c95e1-cdde-4ccd-a75b-534f11592b82" containerName="main"
Jul 16 18:09:12.734417 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.734225    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22c95e1-cdde-4ccd-a75b-534f11592b82" containerName="main"
Jul 16 18:09:12.734417 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.734322    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22c95e1-cdde-4ccd-a75b-534f11592b82" containerName="main"
Jul 16 18:09:12.737242 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.737222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.740055 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.740034    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 18:09:12.740184 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.740164    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 16 18:09:12.740301 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.740260    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-x8k6j\""
Jul 16 18:09:12.740831 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.740812    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 18:09:12.760087 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.760059    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"]
Jul 16 18:09:12.887702 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.887702 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.887938 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.887938 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.887938 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.887938 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.887938 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhlb\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-kube-api-access-fmhlb\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.888136 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.887974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97c17a50-9df3-446c-858d-819f6ba1c6a8-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.888136 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.888022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988491 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988491 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988491 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhlb\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-kube-api-access-fmhlb\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988491 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97c17a50-9df3-446c-858d-819f6ba1c6a8-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988847 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988847 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988847 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988847 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.988847 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.989085 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.988973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.989085 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.989041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.989200 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.989120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.989200 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.989148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.989440 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.989422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97c17a50-9df3-446c-858d-819f6ba1c6a8-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.990852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.990822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.991176 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.991159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.998569 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.998543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhlb\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-kube-api-access-fmhlb\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:12.998681 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:12.998607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-prgpl\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:13.048977 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.048945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:13.191000 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.190952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"]
Jul 16 18:09:13.193760 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:09:13.193732    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c17a50_9df3_446c_858d_819f6ba1c6a8.slice/crio-ed4d99832624fc0d010b585b10a3894657cab2597ebecf292c42e84ee91458d2 WatchSource:0}: Error finding container ed4d99832624fc0d010b585b10a3894657cab2597ebecf292c42e84ee91458d2: Status 404 returned error can't find the container with id ed4d99832624fc0d010b585b10a3894657cab2597ebecf292c42e84ee91458d2
Jul 16 18:09:13.195728 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.195696    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:13.195817 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.195775    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:13.195817 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.195811    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:13.342829 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.342790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl" event={"ID":"97c17a50-9df3-446c-858d-819f6ba1c6a8","Type":"ContainerStarted","Data":"fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455"}
Jul 16 18:09:13.343008 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.342857    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl" event={"ID":"97c17a50-9df3-446c-858d-819f6ba1c6a8","Type":"ContainerStarted","Data":"ed4d99832624fc0d010b585b10a3894657cab2597ebecf292c42e84ee91458d2"}
Jul 16 18:09:13.370411 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:13.370359    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl" podStartSLOduration=1.370341281 podStartE2EDuration="1.370341281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:09:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:09:13.368778052 +0000 UTC m=+2062.004980020" watchObservedRunningTime="2026-07-16 18:09:13.370341281 +0000 UTC m=+2062.006543249"
Jul 16 18:09:14.049610 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.049568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:14.054493 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.054468    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:14.347935 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.347853    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:14.349046 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.349026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:14.607721 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.607630    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"]
Jul 16 18:09:14.611276 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.611250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.623429 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.623405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"]
Jul 16 18:09:14.704770 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.704737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.704945 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.704783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.704945 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.704809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v65sh\" (UniqueName: \"kubernetes.io/projected/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-kube-api-access-v65sh\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.704945 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.704862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.704945 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.704900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.704945 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.704940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.705119 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.704954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.705119 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.705036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.705119 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.705073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806306 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806500 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806500 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806500 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v65sh\" (UniqueName: \"kubernetes.io/projected/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-kube-api-access-v65sh\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806500 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806500 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806500 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806843 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806843 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.806843 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-data\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.807005 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-workload-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.807005 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.806975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-credential-socket\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.807113 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.807021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-workload-certs\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.807167 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.807120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.808708 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.808685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-envoy\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.809079 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.809059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-podinfo\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.816021 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.816000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-istio-token\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.816247 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.816227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v65sh\" (UniqueName: \"kubernetes.io/projected/02b2a0e0-646c-4297-b1c3-5c38a82a1e74-kube-api-access-v65sh\") pod \"router-gateway-1-openshift-default-54c47cdfc7-mw42d\" (UID: \"02b2a0e0-646c-4297-b1c3-5c38a82a1e74\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:14.922386 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:14.922358    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:15.079849 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.079813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"]
Jul 16 18:09:15.081731 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:09:15.081698    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b2a0e0_646c_4297_b1c3_5c38a82a1e74.slice/crio-d4f8a42e2d1f4e311a7929ca2bdffbfeb0a60861a625e51f265a2ed551935312 WatchSource:0}: Error finding container d4f8a42e2d1f4e311a7929ca2bdffbfeb0a60861a625e51f265a2ed551935312: Status 404 returned error can't find the container with id d4f8a42e2d1f4e311a7929ca2bdffbfeb0a60861a625e51f265a2ed551935312
Jul 16 18:09:15.083811 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.083780    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:15.083916 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.083855    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:15.083916 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.083885    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:15.355177 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.355082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" event={"ID":"02b2a0e0-646c-4297-b1c3-5c38a82a1e74","Type":"ContainerStarted","Data":"aea24b3e1022d983cfb2509e845be1c6fabbb2c7cb455807de33e603c2fa0519"}
Jul 16 18:09:15.355177 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.355148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" event={"ID":"02b2a0e0-646c-4297-b1c3-5c38a82a1e74","Type":"ContainerStarted","Data":"d4f8a42e2d1f4e311a7929ca2bdffbfeb0a60861a625e51f265a2ed551935312"}
Jul 16 18:09:15.378950 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.378879    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" podStartSLOduration=1.378854697 podStartE2EDuration="1.378854697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:09:15.37755352 +0000 UTC m=+2064.013755489" watchObservedRunningTime="2026-07-16 18:09:15.378854697 +0000 UTC m=+2064.015056667"
Jul 16 18:09:15.923460 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:15.923415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:16.924927 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:16.924850    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" podUID="02b2a0e0-646c-4297-b1c3-5c38a82a1e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 16 18:09:17.922829 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:17.922779    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" podUID="02b2a0e0-646c-4297-b1c3-5c38a82a1e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 16 18:09:18.923068 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:18.923030    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" podUID="02b2a0e0-646c-4297-b1c3-5c38a82a1e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 16 18:09:19.923253 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:19.923206    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" podUID="02b2a0e0-646c-4297-b1c3-5c38a82a1e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 16 18:09:20.923503 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:20.923457    2580 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d" podUID="02b2a0e0-646c-4297-b1c3-5c38a82a1e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 16 18:09:21.927024 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:21.926989    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:21.927519 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:21.927407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:21.928364 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:21.928340    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d"
Jul 16 18:09:22.069623 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:22.069586    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"]
Jul 16 18:09:22.069912 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:22.069873    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl" podUID="97c17a50-9df3-446c-858d-819f6ba1c6a8" containerName="istio-proxy" containerID="cri-o://fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455" gracePeriod=30
Jul 16 18:09:24.216568 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.216516    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:24.405631 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-certs\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405631 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405635    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-token\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405684    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-envoy\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-podinfo\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405721    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-data\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405737    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmhlb\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-kube-api-access-fmhlb\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-credential-socket\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-socket\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.405852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405825    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97c17a50-9df3-446c-858d-819f6ba1c6a8-istiod-ca-cert\") pod \"97c17a50-9df3-446c-858d-819f6ba1c6a8\" (UID: \"97c17a50-9df3-446c-858d-819f6ba1c6a8\") "
Jul 16 18:09:24.406189 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.405914    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:09:24.406189 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.406122    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.406189 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.406145    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:09:24.406396 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.406374    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:09:24.406465 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.406388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:09:24.406517 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.406483    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c17a50-9df3-446c-858d-819f6ba1c6a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:09:24.408250 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408191    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 18:09:24.408250 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408203    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:09:24.408250 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408216    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-kube-api-access-fmhlb" (OuterVolumeSpecName: "kube-api-access-fmhlb") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "kube-api-access-fmhlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:09:24.408484 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "97c17a50-9df3-446c-858d-819f6ba1c6a8" (UID: "97c17a50-9df3-446c-858d-819f6ba1c6a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:09:24.408631 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408610    2580 generic.go:356] "Generic (PLEG): container finished" podID="97c17a50-9df3-446c-858d-819f6ba1c6a8" containerID="fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455" exitCode=0
Jul 16 18:09:24.408689 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408665    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"
Jul 16 18:09:24.408689 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl" event={"ID":"97c17a50-9df3-446c-858d-819f6ba1c6a8","Type":"ContainerDied","Data":"fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455"}
Jul 16 18:09:24.408783 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl" event={"ID":"97c17a50-9df3-446c-858d-819f6ba1c6a8","Type":"ContainerDied","Data":"ed4d99832624fc0d010b585b10a3894657cab2597ebecf292c42e84ee91458d2"}
Jul 16 18:09:24.408783 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.408740    2580 scope.go:117] "RemoveContainer" containerID="fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455"
Jul 16 18:09:24.425652 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.425637    2580 scope.go:117] "RemoveContainer" containerID="fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455"
Jul 16 18:09:24.425885 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:09:24.425864    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455\": container with ID starting with fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455 not found: ID does not exist" containerID="fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455"
Jul 16 18:09:24.425941 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.425891    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455"} err="failed to get container status \"fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455\": rpc error: code = NotFound desc = could not find container \"fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455\": container with ID starting with fcdfc53015083208d9ae455a5ef5accef4c47de4349b4b9ee5a99da48406c455 not found: ID does not exist"
Jul 16 18:09:24.439688 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.439662    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"]
Jul 16 18:09:24.444969 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.444950    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl"]
Jul 16 18:09:24.507222 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507200    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-credential-socket\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.507222 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507223    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-workload-socket\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.507381 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507235    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97c17a50-9df3-446c-858d-819f6ba1c6a8-istiod-ca-cert\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.507381 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507243    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-token\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.507381 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507252    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-envoy\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.507381 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507260    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-podinfo\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.507381 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507269    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97c17a50-9df3-446c-858d-819f6ba1c6a8-istio-data\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:24.507381 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:24.507296    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmhlb\" (UniqueName: \"kubernetes.io/projected/97c17a50-9df3-446c-858d-819f6ba1c6a8-kube-api-access-fmhlb\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:09:26.193613 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:26.193564    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c17a50-9df3-446c-858d-819f6ba1c6a8" path="/var/lib/kubelet/pods/97c17a50-9df3-446c-858d-819f6ba1c6a8/volumes"
Jul 16 18:09:52.046742 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:52.046712    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:09:52.049999 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:52.049977    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:09:52.051210 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:52.051188    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:09:52.054581 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:09:52.054563    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:14:52.074227 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:14:52.074202    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:14:52.078256 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:14:52.078229    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:14:52.078505 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:14:52.078483    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:14:52.082595 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:14:52.082571    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:19:52.107742 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:19:52.107709    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:19:52.111312 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:19:52.111269    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:19:52.112294 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:19:52.112259    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:19:52.115855 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:19:52.115835    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:24:52.137011 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:24:52.136980    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:24:52.140043 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:24:52.140017    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:24:52.142063 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:24:52.142045    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:24:52.144735 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:24:52.144717    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:29:52.164636 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:29:52.164519    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:29:52.168692 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:29:52.168674    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:29:52.168815 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:29:52.168799    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:29:52.172952 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:29:52.172934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:32:35.599846 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.599809    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"]
Jul 16 18:32:35.600445 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.600185    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c17a50-9df3-446c-858d-819f6ba1c6a8" containerName="istio-proxy"
Jul 16 18:32:35.600445 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.600197    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c17a50-9df3-446c-858d-819f6ba1c6a8" containerName="istio-proxy"
Jul 16 18:32:35.600445 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.600265    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c17a50-9df3-446c-858d-819f6ba1c6a8" containerName="istio-proxy"
Jul 16 18:32:35.603151 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.603133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.608297 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.608264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Jul 16 18:32:35.608429 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.608331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 18:32:35.620066 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.620036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"]
Jul 16 18:32:35.696216 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.696184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttj5f\" (UniqueName: \"kubernetes.io/projected/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-kube-api-access-ttj5f\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.696216 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.696220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-model-cache\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.696413 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.696256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-dshm\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.696413 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.696319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tls-certs\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.696413 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.696380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tmp-dir\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.696413 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.696411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-home\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797060 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tmp-dir\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797225 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-home\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797225 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttj5f\" (UniqueName: \"kubernetes.io/projected/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-kube-api-access-ttj5f\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797225 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-model-cache\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797225 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-dshm\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797225 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tls-certs\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797550 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tmp-dir\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797617 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-home\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.797617 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.797572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-model-cache\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.799472 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.799450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-dshm\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.799756 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.799737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tls-certs\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.808617 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.808598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttj5f\" (UniqueName: \"kubernetes.io/projected/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-kube-api-access-ttj5f\") pod \"rolling-upgrade-test-kserve-54bc76f55b-pmrdl\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") " pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:35.914027 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:35.914000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:36.050852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:36.050824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"]
Jul 16 18:32:36.053119 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:32:36.053092    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d46fdce_d962_4dfd_bd7c_bc109c675bc2.slice/crio-9c4f224ee0515a3bb0306021fc6f9c8ad4012913a3c240e443ee7b6da3a21f64 WatchSource:0}: Error finding container 9c4f224ee0515a3bb0306021fc6f9c8ad4012913a3c240e443ee7b6da3a21f64: Status 404 returned error can't find the container with id 9c4f224ee0515a3bb0306021fc6f9c8ad4012913a3c240e443ee7b6da3a21f64
Jul 16 18:32:36.833148 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:36.833113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl" event={"ID":"1d46fdce-d962-4dfd-bd7c-bc109c675bc2","Type":"ContainerStarted","Data":"f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1"}
Jul 16 18:32:36.833533 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:36.833171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl" event={"ID":"1d46fdce-d962-4dfd-bd7c-bc109c675bc2","Type":"ContainerStarted","Data":"9c4f224ee0515a3bb0306021fc6f9c8ad4012913a3c240e443ee7b6da3a21f64"}
Jul 16 18:32:36.855995 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:36.855949    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl" podStartSLOduration=1.855933982 podStartE2EDuration="1.855933982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:32:36.854385261 +0000 UTC m=+3465.490587229" watchObservedRunningTime="2026-07-16 18:32:36.855933982 +0000 UTC m=+3465.492135950"
Jul 16 18:32:36.915048 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:36.915019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:45.914444 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:45.914409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:45.926699 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:45.926674    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:32:46.898169 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:32:46.898132    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:33:48.135528 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:33:48.135197    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"]
Jul 16 18:34:03.156246 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.156178    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl" podUID="1d46fdce-d962-4dfd-bd7c-bc109c675bc2" containerName="main" containerID="cri-o://f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1" gracePeriod=45
Jul 16 18:34:03.408737 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.408676    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:34:03.491059 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491029    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-dshm\") pod \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") "
Jul 16 18:34:03.491059 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491059    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tls-certs\") pod \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") "
Jul 16 18:34:03.491272 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491104    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttj5f\" (UniqueName: \"kubernetes.io/projected/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-kube-api-access-ttj5f\") pod \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") "
Jul 16 18:34:03.491272 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491122    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tmp-dir\") pod \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") "
Jul 16 18:34:03.491272 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491258    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-model-cache\") pod \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") "
Jul 16 18:34:03.491461 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-home\") pod \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\" (UID: \"1d46fdce-d962-4dfd-bd7c-bc109c675bc2\") "
Jul 16 18:34:03.491461 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491436    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d46fdce-d962-4dfd-bd7c-bc109c675bc2" (UID: "1d46fdce-d962-4dfd-bd7c-bc109c675bc2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:34:03.491628 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491597    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d46fdce-d962-4dfd-bd7c-bc109c675bc2" (UID: "1d46fdce-d962-4dfd-bd7c-bc109c675bc2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:34:03.491689 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491629    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-home" (OuterVolumeSpecName: "home") pod "1d46fdce-d962-4dfd-bd7c-bc109c675bc2" (UID: "1d46fdce-d962-4dfd-bd7c-bc109c675bc2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:34:03.491799 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491780    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:34:03.491867 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491804    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:34:03.491867 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.491824    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:34:03.493305 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.493261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-dshm" (OuterVolumeSpecName: "dshm") pod "1d46fdce-d962-4dfd-bd7c-bc109c675bc2" (UID: "1d46fdce-d962-4dfd-bd7c-bc109c675bc2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:34:03.493398 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.493367    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d46fdce-d962-4dfd-bd7c-bc109c675bc2" (UID: "1d46fdce-d962-4dfd-bd7c-bc109c675bc2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:34:03.493486 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.493460    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-kube-api-access-ttj5f" (OuterVolumeSpecName: "kube-api-access-ttj5f") pod "1d46fdce-d962-4dfd-bd7c-bc109c675bc2" (UID: "1d46fdce-d962-4dfd-bd7c-bc109c675bc2"). InnerVolumeSpecName "kube-api-access-ttj5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:34:03.592671 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.592645    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:34:03.592671 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.592670    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:34:03.592821 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:03.592680    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttj5f\" (UniqueName: \"kubernetes.io/projected/1d46fdce-d962-4dfd-bd7c-bc109c675bc2-kube-api-access-ttj5f\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:34:04.237166 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.237133    2580 generic.go:356] "Generic (PLEG): container finished" podID="1d46fdce-d962-4dfd-bd7c-bc109c675bc2" containerID="f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1" exitCode=0
Jul 16 18:34:04.237520 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.237179    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"
Jul 16 18:34:04.237520 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.237221    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl" event={"ID":"1d46fdce-d962-4dfd-bd7c-bc109c675bc2","Type":"ContainerDied","Data":"f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1"}
Jul 16 18:34:04.237520 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.237293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl" event={"ID":"1d46fdce-d962-4dfd-bd7c-bc109c675bc2","Type":"ContainerDied","Data":"9c4f224ee0515a3bb0306021fc6f9c8ad4012913a3c240e443ee7b6da3a21f64"}
Jul 16 18:34:04.237520 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.237319    2580 scope.go:117] "RemoveContainer" containerID="f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1"
Jul 16 18:34:04.245739 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.245720    2580 scope.go:117] "RemoveContainer" containerID="f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1"
Jul 16 18:34:04.246010 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:34:04.245991    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1\": container with ID starting with f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1 not found: ID does not exist" containerID="f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1"
Jul 16 18:34:04.246051 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.246020    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1"} err="failed to get container status \"f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1\": rpc error: code = NotFound desc = could not find container \"f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1\": container with ID starting with f9ba92e8223317357480ed50d6dcd8c2f25530e7dd8d48a8b2e2363903cf09f1 not found: ID does not exist"
Jul 16 18:34:04.263026 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.263000    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"]
Jul 16 18:34:04.271712 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:04.271690    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl"]
Jul 16 18:34:06.193173 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:06.193136    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d46fdce-d962-4dfd-bd7c-bc109c675bc2" path="/var/lib/kubelet/pods/1d46fdce-d962-4dfd-bd7c-bc109c675bc2/volumes"
Jul 16 18:34:52.200912 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:52.200810    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:34:52.207582 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:52.203146    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:34:52.207582 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:52.205138    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:34:52.207582 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:34:52.207314    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:36:02.281977 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.281939    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"]
Jul 16 18:36:02.282532 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.282355    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d46fdce-d962-4dfd-bd7c-bc109c675bc2" containerName="main"
Jul 16 18:36:02.282532 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.282370    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d46fdce-d962-4dfd-bd7c-bc109c675bc2" containerName="main"
Jul 16 18:36:02.282532 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.282455    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d46fdce-d962-4dfd-bd7c-bc109c675bc2" containerName="main"
Jul 16 18:36:02.285602 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.285581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.290470 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.290447    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 18:36:02.290590 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.290483    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jul 16 18:36:02.296612 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.296591    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"]
Jul 16 18:36:02.327615 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.327593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.327722 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.327628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.327722 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.327650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.327847 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.327742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.327904 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.327859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbhpf\" (UniqueName: \"kubernetes.io/projected/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-kube-api-access-gbhpf\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.327957 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.327906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429090 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbhpf\" (UniqueName: \"kubernetes.io/projected/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-kube-api-access-gbhpf\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429237 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429237 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429237 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429237 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429480 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429642 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429712 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-home\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.429801 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.429786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-model-cache\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.431428 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.431407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-dshm\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.431640 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.431620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.439401 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.439380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbhpf\" (UniqueName: \"kubernetes.io/projected/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-kube-api-access-gbhpf\") pod \"scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.596350 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.596240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:02.734471 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.734432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"]
Jul 16 18:36:02.737128 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:36:02.737096    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cf5f0d_4826_4cff_9e01_7fed2d1821c6.slice/crio-63b2e5372e015196fe57b71a42d6ba65c0f9b1e9f9481136b3202695f00fe1f3 WatchSource:0}: Error finding container 63b2e5372e015196fe57b71a42d6ba65c0f9b1e9f9481136b3202695f00fe1f3: Status 404 returned error can't find the container with id 63b2e5372e015196fe57b71a42d6ba65c0f9b1e9f9481136b3202695f00fe1f3
Jul 16 18:36:02.761524 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:02.761497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt" event={"ID":"08cf5f0d-4826-4cff-9e01-7fed2d1821c6","Type":"ContainerStarted","Data":"63b2e5372e015196fe57b71a42d6ba65c0f9b1e9f9481136b3202695f00fe1f3"}
Jul 16 18:36:03.768101 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:03.768068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt" event={"ID":"08cf5f0d-4826-4cff-9e01-7fed2d1821c6","Type":"ContainerStarted","Data":"eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d"}
Jul 16 18:36:03.799959 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:03.799909    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt" podStartSLOduration=1.799893709 podStartE2EDuration="1.799893709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:36:03.798475456 +0000 UTC m=+3672.434677425" watchObservedRunningTime="2026-07-16 18:36:03.799893709 +0000 UTC m=+3672.436095676"
Jul 16 18:36:04.596629 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:04.596601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:12.596593 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:12.596562    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:12.609022 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:12.608997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:36:12.820089 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:36:12.820059    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:37:05.344304 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:05.344252    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"]
Jul 16 18:37:20.365967 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.365929    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt" podUID="08cf5f0d-4826-4cff-9e01-7fed2d1821c6" containerName="main" containerID="cri-o://eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d" gracePeriod=45
Jul 16 18:37:20.607015 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.606984    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:37:20.667491 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667422    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-dshm\") pod \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") "
Jul 16 18:37:20.667491 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667456    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-home\") pod \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") "
Jul 16 18:37:20.667491 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-model-cache\") pod \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") "
Jul 16 18:37:20.667807 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667512    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbhpf\" (UniqueName: \"kubernetes.io/projected/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-kube-api-access-gbhpf\") pod \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") "
Jul 16 18:37:20.667807 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667573    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tmp-dir\") pod \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") "
Jul 16 18:37:20.667807 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tls-certs\") pod \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\" (UID: \"08cf5f0d-4826-4cff-9e01-7fed2d1821c6\") "
Jul 16 18:37:20.667807 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667757    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "08cf5f0d-4826-4cff-9e01-7fed2d1821c6" (UID: "08cf5f0d-4826-4cff-9e01-7fed2d1821c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:37:20.667807 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667767    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-home" (OuterVolumeSpecName: "home") pod "08cf5f0d-4826-4cff-9e01-7fed2d1821c6" (UID: "08cf5f0d-4826-4cff-9e01-7fed2d1821c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:37:20.668069 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667909    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "08cf5f0d-4826-4cff-9e01-7fed2d1821c6" (UID: "08cf5f0d-4826-4cff-9e01-7fed2d1821c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:37:20.668069 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.667994    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:37:20.668069 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.668013    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:37:20.668069 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.668029    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:37:20.669625 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.669601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-dshm" (OuterVolumeSpecName: "dshm") pod "08cf5f0d-4826-4cff-9e01-7fed2d1821c6" (UID: "08cf5f0d-4826-4cff-9e01-7fed2d1821c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:37:20.669721 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.669622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-kube-api-access-gbhpf" (OuterVolumeSpecName: "kube-api-access-gbhpf") pod "08cf5f0d-4826-4cff-9e01-7fed2d1821c6" (UID: "08cf5f0d-4826-4cff-9e01-7fed2d1821c6"). InnerVolumeSpecName "kube-api-access-gbhpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:37:20.669721 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.669660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "08cf5f0d-4826-4cff-9e01-7fed2d1821c6" (UID: "08cf5f0d-4826-4cff-9e01-7fed2d1821c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:37:20.769230 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.769205    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:37:20.769230 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.769227    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:37:20.769407 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:20.769236    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbhpf\" (UniqueName: \"kubernetes.io/projected/08cf5f0d-4826-4cff-9e01-7fed2d1821c6-kube-api-access-gbhpf\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:37:21.137337 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.137301    2580 generic.go:356] "Generic (PLEG): container finished" podID="08cf5f0d-4826-4cff-9e01-7fed2d1821c6" containerID="eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d" exitCode=0
Jul 16 18:37:21.137337 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.137339    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"
Jul 16 18:37:21.137536 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.137373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt" event={"ID":"08cf5f0d-4826-4cff-9e01-7fed2d1821c6","Type":"ContainerDied","Data":"eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d"}
Jul 16 18:37:21.137536 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.137427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt" event={"ID":"08cf5f0d-4826-4cff-9e01-7fed2d1821c6","Type":"ContainerDied","Data":"63b2e5372e015196fe57b71a42d6ba65c0f9b1e9f9481136b3202695f00fe1f3"}
Jul 16 18:37:21.137536 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.137452    2580 scope.go:117] "RemoveContainer" containerID="eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d"
Jul 16 18:37:21.147627 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.147611    2580 scope.go:117] "RemoveContainer" containerID="eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d"
Jul 16 18:37:21.147877 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:37:21.147861    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d\": container with ID starting with eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d not found: ID does not exist" containerID="eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d"
Jul 16 18:37:21.147918 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.147884    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d"} err="failed to get container status \"eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d\": rpc error: code = NotFound desc = could not find container \"eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d\": container with ID starting with eaff76f7249eef44bb6363a97f966526a38c677d3953aec636d995ce2579842d not found: ID does not exist"
Jul 16 18:37:21.164858 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.164832    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"]
Jul 16 18:37:21.169317 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:21.169297    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt"]
Jul 16 18:37:22.193787 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:22.193758    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08cf5f0d-4826-4cff-9e01-7fed2d1821c6" path="/var/lib/kubelet/pods/08cf5f0d-4826-4cff-9e01-7fed2d1821c6/volumes"
Jul 16 18:37:54.565190 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.565156    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"]
Jul 16 18:37:54.565598 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.565568    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08cf5f0d-4826-4cff-9e01-7fed2d1821c6" containerName="main"
Jul 16 18:37:54.565598 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.565582    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="08cf5f0d-4826-4cff-9e01-7fed2d1821c6" containerName="main"
Jul 16 18:37:54.565673 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.565653    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="08cf5f0d-4826-4cff-9e01-7fed2d1821c6" containerName="main"
Jul 16 18:37:54.570052 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.570033    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.575156 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.575137    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j4fsz\""
Jul 16 18:37:54.575889 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.575869    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Jul 16 18:37:54.575965 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.575946    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-dockercfg-ncsbm\""
Jul 16 18:37:54.603019 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.602990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"]
Jul 16 18:37:54.632671 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.632646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.632822 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.632674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.632822 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.632702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e947357-7238-43b5-b2bf-1729139fe56a-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.632822 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.632765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-home\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.632822 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.632787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.632822 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.632804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/7e947357-7238-43b5-b2bf-1729139fe56a-kube-api-access-6fld8\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.733938 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.733903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734105 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.733948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734105 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.733988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e947357-7238-43b5-b2bf-1729139fe56a-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734105 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.734069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-home\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734292 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.734109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734292 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.734139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/7e947357-7238-43b5-b2bf-1729139fe56a-kube-api-access-6fld8\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734487 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.734464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734563 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.734519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.734602 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.734583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-home\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.736221 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.736203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.736515 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.736491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e947357-7238-43b5-b2bf-1729139fe56a-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.749335 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.749312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/7e947357-7238-43b5-b2bf-1729139fe56a-kube-api-access-6fld8\") pod \"scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:54.879250 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:54.879220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:55.021322 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:55.021294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"]
Jul 16 18:37:55.023304 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:37:55.023263    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e947357_7238_43b5_b2bf_1729139fe56a.slice/crio-3a70f2ad39fe2ac65c17e0e11746bccdf6da2a7dc99c668f7a33891da662ed70 WatchSource:0}: Error finding container 3a70f2ad39fe2ac65c17e0e11746bccdf6da2a7dc99c668f7a33891da662ed70: Status 404 returned error can't find the container with id 3a70f2ad39fe2ac65c17e0e11746bccdf6da2a7dc99c668f7a33891da662ed70
Jul 16 18:37:55.025181 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:55.025164    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:37:55.299981 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:55.299904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" event={"ID":"7e947357-7238-43b5-b2bf-1729139fe56a","Type":"ContainerStarted","Data":"3a70f2ad39fe2ac65c17e0e11746bccdf6da2a7dc99c668f7a33891da662ed70"}
Jul 16 18:37:58.316856 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:58.316816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" event={"ID":"7e947357-7238-43b5-b2bf-1729139fe56a","Type":"ContainerStarted","Data":"a1e187cf95ed0bc8522728d6174c35a104cf9699a402df231692c57daa4e953c"}
Jul 16 18:37:58.317329 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:58.316960    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:37:59.325341 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:59.325307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" event={"ID":"7e947357-7238-43b5-b2bf-1729139fe56a","Type":"ContainerStarted","Data":"f3051040295e455c44958941c19487672f661449c617d5297556e7f73a91ba9d"}
Jul 16 18:37:59.348342 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:59.348276    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" podStartSLOduration=2.765006648 podStartE2EDuration="5.348259488s" totalImagesPullingTime="2.58325284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:37:59.345839444 +0000 UTC m=+3787.982041414" watchObservedRunningTime="2026-07-16 18:37:59.348259488 +0000 UTC m=+3787.984461455"
Jul 16 18:37:59.880381 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:37:59.880346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:38:04.879728 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:04.879691    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:38:04.891977 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:04.891949    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:38:05.364024 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:05.364000    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:38:16.369473 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:16.369443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:38:28.269033 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:28.269000    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"]
Jul 16 18:38:43.291382 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.291325    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="main" containerID="cri-o://f3051040295e455c44958941c19487672f661449c617d5297556e7f73a91ba9d" gracePeriod=45
Jul 16 18:38:43.353610 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.353575    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8001/health\": dial tcp 10.134.0.42:8001: connect: connection refused"
Jul 16 18:38:43.408009 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.407962    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="llm-d-routing-sidecar" containerID="cri-o://a1e187cf95ed0bc8522728d6174c35a104cf9699a402df231692c57daa4e953c" gracePeriod=45
Jul 16 18:38:43.533323 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.533294    2580 generic.go:356] "Generic (PLEG): container finished" podID="7e947357-7238-43b5-b2bf-1729139fe56a" containerID="f3051040295e455c44958941c19487672f661449c617d5297556e7f73a91ba9d" exitCode=0
Jul 16 18:38:43.533323 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.533321    2580 generic.go:356] "Generic (PLEG): container finished" podID="7e947357-7238-43b5-b2bf-1729139fe56a" containerID="a1e187cf95ed0bc8522728d6174c35a104cf9699a402df231692c57daa4e953c" exitCode=0
Jul 16 18:38:43.533472 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.533313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" event={"ID":"7e947357-7238-43b5-b2bf-1729139fe56a","Type":"ContainerDied","Data":"f3051040295e455c44958941c19487672f661449c617d5297556e7f73a91ba9d"}
Jul 16 18:38:43.533472 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.533381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" event={"ID":"7e947357-7238-43b5-b2bf-1729139fe56a","Type":"ContainerDied","Data":"a1e187cf95ed0bc8522728d6174c35a104cf9699a402df231692c57daa4e953c"}
Jul 16 18:38:43.665333 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.665307    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:38:43.745167 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745141    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-home\") pod \"7e947357-7238-43b5-b2bf-1729139fe56a\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") "
Jul 16 18:38:43.745346 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745175    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/7e947357-7238-43b5-b2bf-1729139fe56a-kube-api-access-6fld8\") pod \"7e947357-7238-43b5-b2bf-1729139fe56a\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") "
Jul 16 18:38:43.745346 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-dshm\") pod \"7e947357-7238-43b5-b2bf-1729139fe56a\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") "
Jul 16 18:38:43.745346 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745257    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e947357-7238-43b5-b2bf-1729139fe56a-tls-certs\") pod \"7e947357-7238-43b5-b2bf-1729139fe56a\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") "
Jul 16 18:38:43.745346 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-tmp-dir\") pod \"7e947357-7238-43b5-b2bf-1729139fe56a\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") "
Jul 16 18:38:43.745562 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745363    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-model-cache\") pod \"7e947357-7238-43b5-b2bf-1729139fe56a\" (UID: \"7e947357-7238-43b5-b2bf-1729139fe56a\") "
Jul 16 18:38:43.745562 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745482    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-home" (OuterVolumeSpecName: "home") pod "7e947357-7238-43b5-b2bf-1729139fe56a" (UID: "7e947357-7238-43b5-b2bf-1729139fe56a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:38:43.745662 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e947357-7238-43b5-b2bf-1729139fe56a" (UID: "7e947357-7238-43b5-b2bf-1729139fe56a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:38:43.745662 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745657    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-home\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:38:43.745743 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.745656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e947357-7238-43b5-b2bf-1729139fe56a" (UID: "7e947357-7238-43b5-b2bf-1729139fe56a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:38:43.747410 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.747387    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-dshm" (OuterVolumeSpecName: "dshm") pod "7e947357-7238-43b5-b2bf-1729139fe56a" (UID: "7e947357-7238-43b5-b2bf-1729139fe56a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:38:43.747410 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.747398    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e947357-7238-43b5-b2bf-1729139fe56a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e947357-7238-43b5-b2bf-1729139fe56a" (UID: "7e947357-7238-43b5-b2bf-1729139fe56a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:38:43.747527 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.747461    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e947357-7238-43b5-b2bf-1729139fe56a-kube-api-access-6fld8" (OuterVolumeSpecName: "kube-api-access-6fld8") pod "7e947357-7238-43b5-b2bf-1729139fe56a" (UID: "7e947357-7238-43b5-b2bf-1729139fe56a"). InnerVolumeSpecName "kube-api-access-6fld8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:38:43.846799 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.846731    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e947357-7238-43b5-b2bf-1729139fe56a-tls-certs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:38:43.846799 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.846755    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-tmp-dir\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:38:43.846799 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.846764    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-model-cache\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:38:43.846799 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.846772    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fld8\" (UniqueName: \"kubernetes.io/projected/7e947357-7238-43b5-b2bf-1729139fe56a-kube-api-access-6fld8\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:38:43.846799 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:43.846782    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e947357-7238-43b5-b2bf-1729139fe56a-dshm\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:38:44.540470 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:44.540369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs" event={"ID":"7e947357-7238-43b5-b2bf-1729139fe56a","Type":"ContainerDied","Data":"3a70f2ad39fe2ac65c17e0e11746bccdf6da2a7dc99c668f7a33891da662ed70"}
Jul 16 18:38:44.540470 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:44.540397    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"
Jul 16 18:38:44.540470 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:44.540448    2580 scope.go:117] "RemoveContainer" containerID="f3051040295e455c44958941c19487672f661449c617d5297556e7f73a91ba9d"
Jul 16 18:38:44.548902 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:44.548886    2580 scope.go:117] "RemoveContainer" containerID="a1e187cf95ed0bc8522728d6174c35a104cf9699a402df231692c57daa4e953c"
Jul 16 18:38:44.561141 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:44.561117    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"]
Jul 16 18:38:44.567744 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:44.567720    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs"]
Jul 16 18:38:46.193004 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:38:46.192968    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" path="/var/lib/kubelet/pods/7e947357-7238-43b5-b2bf-1729139fe56a/volumes"
Jul 16 18:39:52.227452 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:39:52.227338    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:39:52.232079 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:39:52.232058    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:39:52.232241 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:39:52.232216    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:39:52.236799 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:39:52.236781    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:44:52.253846 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:44:52.253748    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:44:52.258272 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:44:52.258252    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:44:52.260262 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:44:52.260242    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:44:52.264739 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:44:52.264723    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:49:52.287041 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:49:52.286911    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:49:52.292442 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:49:52.292419    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:49:52.294275 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:49:52.294253    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:49:52.299398 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:49:52.299379    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:54:52.315956 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:54:52.315850    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:54:52.320464 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:54:52.320432    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:54:52.324171 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:54:52.324149    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:54:52.328330 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:54:52.328311    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vqpm_7e0622d5-6433-4682-8ba3-df91b3f9e190/ovn-acl-logging/0.log"
Jul 16 18:56:26.971781 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.971748    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wn9zv/must-gather-zbszc"]
Jul 16 18:56:26.972247 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.972087    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="main"
Jul 16 18:56:26.972247 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.972098    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="main"
Jul 16 18:56:26.972247 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.972119    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="llm-d-routing-sidecar"
Jul 16 18:56:26.972247 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.972125    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="llm-d-routing-sidecar"
Jul 16 18:56:26.972247 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.972184    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="llm-d-routing-sidecar"
Jul 16 18:56:26.972247 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.972194    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e947357-7238-43b5-b2bf-1729139fe56a" containerName="main"
Jul 16 18:56:26.975164 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.975142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:26.977601 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.977572    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wn9zv\"/\"default-dockercfg-msjkj\""
Jul 16 18:56:26.977694 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.977617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn9zv\"/\"openshift-service-ca.crt\""
Jul 16 18:56:26.978428 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.978406    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn9zv\"/\"kube-root-ca.crt\""
Jul 16 18:56:26.993380 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:26.993355    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn9zv/must-gather-zbszc"]
Jul 16 18:56:27.108554 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.108529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrfjs\" (UniqueName: \"kubernetes.io/projected/69caef12-f159-43da-9382-97808a6931af-kube-api-access-zrfjs\") pod \"must-gather-zbszc\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") " pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:27.108654 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.108579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69caef12-f159-43da-9382-97808a6931af-must-gather-output\") pod \"must-gather-zbszc\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") " pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:27.209492 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.209472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69caef12-f159-43da-9382-97808a6931af-must-gather-output\") pod \"must-gather-zbszc\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") " pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:27.209617 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.209531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrfjs\" (UniqueName: \"kubernetes.io/projected/69caef12-f159-43da-9382-97808a6931af-kube-api-access-zrfjs\") pod \"must-gather-zbszc\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") " pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:27.209782 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.209765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69caef12-f159-43da-9382-97808a6931af-must-gather-output\") pod \"must-gather-zbszc\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") " pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:27.219671 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.219652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrfjs\" (UniqueName: \"kubernetes.io/projected/69caef12-f159-43da-9382-97808a6931af-kube-api-access-zrfjs\") pod \"must-gather-zbszc\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") " pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:27.284426 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.284371    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:56:27.415089 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.415064    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn9zv/must-gather-zbszc"]
Jul 16 18:56:27.417591 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:56:27.417563    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69caef12_f159_43da_9382_97808a6931af.slice/crio-0fbcb5af06227c3943f975fc2d7cd1c388caaead9272d0e4a0f3b128b57d3b08 WatchSource:0}: Error finding container 0fbcb5af06227c3943f975fc2d7cd1c388caaead9272d0e4a0f3b128b57d3b08: Status 404 returned error can't find the container with id 0fbcb5af06227c3943f975fc2d7cd1c388caaead9272d0e4a0f3b128b57d3b08
Jul 16 18:56:27.419735 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:27.419716    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:56:28.422209 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:28.422132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn9zv/must-gather-zbszc" event={"ID":"69caef12-f159-43da-9382-97808a6931af","Type":"ContainerStarted","Data":"0fbcb5af06227c3943f975fc2d7cd1c388caaead9272d0e4a0f3b128b57d3b08"}
Jul 16 18:56:34.455579 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:34.455543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn9zv/must-gather-zbszc" event={"ID":"69caef12-f159-43da-9382-97808a6931af","Type":"ContainerStarted","Data":"7d519367cc2ac23fe8b3ec2b738862615a96eb789b6dac86a0f9bdb89cb1fc83"}
Jul 16 18:56:34.456103 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:34.455585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn9zv/must-gather-zbszc" event={"ID":"69caef12-f159-43da-9382-97808a6931af","Type":"ContainerStarted","Data":"a2ffb6e494e3ae975f977f7c6381592938b2cff070085fc66366c8e165138fdb"}
Jul 16 18:56:34.474199 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:34.474120    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wn9zv/must-gather-zbszc" podStartSLOduration=2.370953573 podStartE2EDuration="8.474099279s" totalImagesPullingTime="6.103145706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:56:34.473743859 +0000 UTC m=+4903.109945829" watchObservedRunningTime="2026-07-16 18:56:34.474099279 +0000 UTC m=+4903.110301249"
Jul 16 18:56:42.630370 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:42.630337    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:44.271397 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:44.271362    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:45.864650 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:45.864618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:47.491667 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:47.491640    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:49.111599 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:49.111570    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:50.737151 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:50.737111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:52.346255 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:52.346211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:53.997553 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:53.997526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:55.921004 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:55.920970    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:57.552372 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:57.552339    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:56:59.161594 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:56:59.161562    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:57:00.753640 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:00.753612    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:57:02.385013 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:02.384985    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:57:03.998901 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:03.998871    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:57:05.625664 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:05.625631    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:57:07.229105 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:07.229076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-54c47cdfc7-mw42d_02b2a0e0-646c-4297-b1c3-5c38a82a1e74/istio-proxy/0.log"
Jul 16 18:57:09.189088 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:09.189054    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wnhkc_247c3d33-3bd8-4566-9752-08f0fd38caa4/discovery/0.log"
Jul 16 18:57:10.510268 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:10.510233    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wnhkc_247c3d33-3bd8-4566-9752-08f0fd38caa4/discovery/0.log"
Jul 16 18:57:11.814170 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:11.814126    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wnhkc_247c3d33-3bd8-4566-9752-08f0fd38caa4/discovery/0.log"
Jul 16 18:57:13.111323 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:13.111275    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wnhkc_247c3d33-3bd8-4566-9752-08f0fd38caa4/discovery/0.log"
Jul 16 18:57:14.177517 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:14.177484    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:14.334523 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:14.334481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:14.344770 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:14.344741    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:14.365549 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:14.365523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:15.470081 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:15.470050    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:15.632385 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:15.632358    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:15.646270 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:15.646245    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:15.664714 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:15.664686    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:16.779949 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:16.779912    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:16.937492 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:16.937462    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:16.947768 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:16.947738    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:16.965250 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:16.965232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:18.024119 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:18.024086    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:18.188633 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:18.188606    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:18.198891 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:18.198866    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:18.214398 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:18.214356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:19.274552 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:19.274518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:19.441657 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:19.441618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:19.454795 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:19.454774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:19.472917 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:19.472894    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:20.563946 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:20.563911    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:20.729834 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:20.729805    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:20.742412 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:20.742386    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:20.771982 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:20.771954    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:21.833436 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:21.833401    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:22.000964 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:22.000937    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:22.014388 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:22.014362    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:22.030829 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:22.030803    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:23.106532 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:23.106504    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:23.266140 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:23.266107    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:23.276573 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:23.276553    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:23.293767 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:23.293735    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:24.364890 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:24.364848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:24.521975 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:24.521940    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:24.532473 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:24.532453    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:24.549823 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:24.549800    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:25.617790 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:25.617763    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:25.787633 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:25.787595    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:25.797883 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:25.797854    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:25.813823 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:25.813805    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:26.886196 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:26.886150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:27.047483 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:27.047456    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:27.058481 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:27.058456    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:27.074962 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:27.074930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:28.753448 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:28.753416    2580 generic.go:356] "Generic (PLEG): container finished" podID="69caef12-f159-43da-9382-97808a6931af" containerID="a2ffb6e494e3ae975f977f7c6381592938b2cff070085fc66366c8e165138fdb" exitCode=0
Jul 16 18:57:28.753855 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:28.753477    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn9zv/must-gather-zbszc" event={"ID":"69caef12-f159-43da-9382-97808a6931af","Type":"ContainerDied","Data":"a2ffb6e494e3ae975f977f7c6381592938b2cff070085fc66366c8e165138fdb"}
Jul 16 18:57:28.753855 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:28.753747    2580 scope.go:117] "RemoveContainer" containerID="a2ffb6e494e3ae975f977f7c6381592938b2cff070085fc66366c8e165138fdb"
Jul 16 18:57:28.888628 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:28.886343    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wn9zv_must-gather-zbszc_69caef12-f159-43da-9382-97808a6931af/gather/0.log"
Jul 16 18:57:29.748025 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.747994    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kt8tj/must-gather-xbqkf"]
Jul 16 18:57:29.752664 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.752643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:29.755193 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.755173    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kt8tj\"/\"openshift-service-ca.crt\""
Jul 16 18:57:29.755616 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.755251    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kt8tj\"/\"kube-root-ca.crt\""
Jul 16 18:57:29.756650 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.756622    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kt8tj\"/\"default-dockercfg-px8tg\""
Jul 16 18:57:29.758478 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.758457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kt8tj/must-gather-xbqkf"]
Jul 16 18:57:29.868388 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.868352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/08e5a0f3-4086-4e92-b592-24a6626aed03-must-gather-output\") pod \"must-gather-xbqkf\" (UID: \"08e5a0f3-4086-4e92-b592-24a6626aed03\") " pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:29.868556 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.868407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw7fl\" (UniqueName: \"kubernetes.io/projected/08e5a0f3-4086-4e92-b592-24a6626aed03-kube-api-access-qw7fl\") pod \"must-gather-xbqkf\" (UID: \"08e5a0f3-4086-4e92-b592-24a6626aed03\") " pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:29.968959 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.968927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw7fl\" (UniqueName: \"kubernetes.io/projected/08e5a0f3-4086-4e92-b592-24a6626aed03-kube-api-access-qw7fl\") pod \"must-gather-xbqkf\" (UID: \"08e5a0f3-4086-4e92-b592-24a6626aed03\") " pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:29.969103 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.969013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/08e5a0f3-4086-4e92-b592-24a6626aed03-must-gather-output\") pod \"must-gather-xbqkf\" (UID: \"08e5a0f3-4086-4e92-b592-24a6626aed03\") " pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:29.969391 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.969373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/08e5a0f3-4086-4e92-b592-24a6626aed03-must-gather-output\") pod \"must-gather-xbqkf\" (UID: \"08e5a0f3-4086-4e92-b592-24a6626aed03\") " pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:29.983090 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:29.983063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw7fl\" (UniqueName: \"kubernetes.io/projected/08e5a0f3-4086-4e92-b592-24a6626aed03-kube-api-access-qw7fl\") pod \"must-gather-xbqkf\" (UID: \"08e5a0f3-4086-4e92-b592-24a6626aed03\") " pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:30.064124 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:30.064069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kt8tj/must-gather-xbqkf"
Jul 16 18:57:30.193647 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:57:30.193617    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08e5a0f3_4086_4e92_b592_24a6626aed03.slice/crio-2412dd44068b6ec84c75c1c5a7a43d300f900829b14bf12707049607341c6719 WatchSource:0}: Error finding container 2412dd44068b6ec84c75c1c5a7a43d300f900829b14bf12707049607341c6719: Status 404 returned error can't find the container with id 2412dd44068b6ec84c75c1c5a7a43d300f900829b14bf12707049607341c6719
Jul 16 18:57:30.194597 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:30.194465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kt8tj/must-gather-xbqkf"]
Jul 16 18:57:30.764786 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:30.764751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kt8tj/must-gather-xbqkf" event={"ID":"08e5a0f3-4086-4e92-b592-24a6626aed03","Type":"ContainerStarted","Data":"2412dd44068b6ec84c75c1c5a7a43d300f900829b14bf12707049607341c6719"}
Jul 16 18:57:31.775350 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:31.775311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kt8tj/must-gather-xbqkf" event={"ID":"08e5a0f3-4086-4e92-b592-24a6626aed03","Type":"ContainerStarted","Data":"aeea9fa29c0cd6422f5f27b7ccc679dc1e920cc958fdc11c8718604e3f39a755"}
Jul 16 18:57:31.776674 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:31.775897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kt8tj/must-gather-xbqkf" event={"ID":"08e5a0f3-4086-4e92-b592-24a6626aed03","Type":"ContainerStarted","Data":"60f53ee807b63b803e682fa1c2bb56588efceb43a249512c09b03a0f2d2805bd"}
Jul 16 18:57:31.794737 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:31.794684    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kt8tj/must-gather-xbqkf" podStartSLOduration=2.001430019 podStartE2EDuration="2.794664721s" totalImagesPullingTime="793.234702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:57:31.79287732 +0000 UTC m=+4960.429079288" watchObservedRunningTime="2026-07-16 18:57:31.794664721 +0000 UTC m=+4960.430866898"
Jul 16 18:57:32.623673 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:32.623639    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qjhmr_0bda17bb-33c0-42f5-aaef-24aa7c479563/global-pull-secret-syncer/0.log"
Jul 16 18:57:32.811005 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:32.810974    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6cg2l_a4236932-fd85-4813-83ca-970f019c66e1/konnectivity-agent/0.log"
Jul 16 18:57:32.838919 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:32.838890    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-180.ec2.internal_a54a8192d9cf200817bbc08086882740/haproxy/0.log"
Jul 16 18:57:34.600646 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:34.594717    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-wn9zv/must-gather-zbszc"]
Jul 16 18:57:34.600646 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:34.594984    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-wn9zv/must-gather-zbszc" podUID="69caef12-f159-43da-9382-97808a6931af" containerName="copy" containerID="cri-o://7d519367cc2ac23fe8b3ec2b738862615a96eb789b6dac86a0f9bdb89cb1fc83" gracePeriod=2
Jul 16 18:57:34.600646 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:34.597445    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-wn9zv/must-gather-zbszc"]
Jul 16 18:57:34.600646 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:57:34.597742    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-zbszc\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wn9zv\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" podUID="69caef12-f159-43da-9382-97808a6931af" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:57:34.797210 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:34.797101    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wn9zv_must-gather-zbszc_69caef12-f159-43da-9382-97808a6931af/copy/0.log"
Jul 16 18:57:34.797932 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:34.797773    2580 generic.go:356] "Generic (PLEG): container finished" podID="69caef12-f159-43da-9382-97808a6931af" containerID="7d519367cc2ac23fe8b3ec2b738862615a96eb789b6dac86a0f9bdb89cb1fc83" exitCode=143
Jul 16 18:57:34.980378 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:34.980333    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wn9zv_must-gather-zbszc_69caef12-f159-43da-9382-97808a6931af/copy/0.log"
Jul 16 18:57:34.985711 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:34.985438    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:57:34.988134 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:57:34.988094    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-zbszc\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wn9zv\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" podUID="69caef12-f159-43da-9382-97808a6931af" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:57:35.120365 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.119575    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69caef12-f159-43da-9382-97808a6931af-must-gather-output\") pod \"69caef12-f159-43da-9382-97808a6931af\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") "
Jul 16 18:57:35.120365 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.119648    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrfjs\" (UniqueName: \"kubernetes.io/projected/69caef12-f159-43da-9382-97808a6931af-kube-api-access-zrfjs\") pod \"69caef12-f159-43da-9382-97808a6931af\" (UID: \"69caef12-f159-43da-9382-97808a6931af\") "
Jul 16 18:57:35.122914 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.122865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69caef12-f159-43da-9382-97808a6931af-kube-api-access-zrfjs" (OuterVolumeSpecName: "kube-api-access-zrfjs") pod "69caef12-f159-43da-9382-97808a6931af" (UID: "69caef12-f159-43da-9382-97808a6931af"). InnerVolumeSpecName "kube-api-access-zrfjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:57:35.131486 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.131458    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69caef12-f159-43da-9382-97808a6931af-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "69caef12-f159-43da-9382-97808a6931af" (UID: "69caef12-f159-43da-9382-97808a6931af"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:57:35.221623 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.221506    2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/69caef12-f159-43da-9382-97808a6931af-must-gather-output\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:57:35.221623 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.221548    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrfjs\" (UniqueName: \"kubernetes.io/projected/69caef12-f159-43da-9382-97808a6931af-kube-api-access-zrfjs\") on node \"ip-10-0-128-180.ec2.internal\" DevicePath \"\""
Jul 16 18:57:35.806906 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.806871    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wn9zv_must-gather-zbszc_69caef12-f159-43da-9382-97808a6931af/copy/0.log"
Jul 16 18:57:35.807467 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.807447    2580 scope.go:117] "RemoveContainer" containerID="7d519367cc2ac23fe8b3ec2b738862615a96eb789b6dac86a0f9bdb89cb1fc83"
Jul 16 18:57:35.807642 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.807625    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:57:35.810862 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:57:35.810817    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-zbszc\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wn9zv\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" podUID="69caef12-f159-43da-9382-97808a6931af" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:57:35.823215 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:35.822213    2580 scope.go:117] "RemoveContainer" containerID="a2ffb6e494e3ae975f977f7c6381592938b2cff070085fc66366c8e165138fdb"
Jul 16 18:57:35.825620 ip-10-0-128-180 kubenswrapper[2580]: E0716 18:57:35.825585    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-zbszc\" is forbidden: User \"system:node:ip-10-0-128-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wn9zv\": no relationship found between node 'ip-10-0-128-180.ec2.internal' and this object" podUID="69caef12-f159-43da-9382-97808a6931af" pod="openshift-must-gather-wn9zv/must-gather-zbszc"
Jul 16 18:57:36.198250 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:36.198203    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69caef12-f159-43da-9382-97808a6931af" path="/var/lib/kubelet/pods/69caef12-f159-43da-9382-97808a6931af/volumes"
Jul 16 18:57:36.944663 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:36.944629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-5q86f_d302cd44-942f-4af5-a463-48cd2f54b55c/manager/0.log"
Jul 16 18:57:37.177319 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:37.176028    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_89fb2699-5d5c-46d5-9a88-bd77f15ea502/manager/0.log"
Jul 16 18:57:37.216353 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:37.214622    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-xfp6q_7032cbbf-e1fc-4e8a-8a48-356be48e692d/limitador/0.log"
Jul 16 18:57:37.257516 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:37.257483    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-5j59b_ca7f2d10-4942-472d-bf28-c9f271a3264c/manager/0.log"
Jul 16 18:57:38.967721 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:38.967635    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-cs72g_261749ae-2172-46e5-8d05-2889805f487c/kube-state-metrics/0.log"
Jul 16 18:57:39.001616 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.001499    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-cs72g_261749ae-2172-46e5-8d05-2889805f487c/kube-rbac-proxy-main/0.log"
Jul 16 18:57:39.026058 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.025871    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-cs72g_261749ae-2172-46e5-8d05-2889805f487c/kube-rbac-proxy-self/0.log"
Jul 16 18:57:39.275312 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.275208    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4xzg_251765a9-10b3-42e7-a064-e469e3a2c3d3/node-exporter/0.log"
Jul 16 18:57:39.314457 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.314423    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4xzg_251765a9-10b3-42e7-a064-e469e3a2c3d3/kube-rbac-proxy/0.log"
Jul 16 18:57:39.337583 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.337553    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4xzg_251765a9-10b3-42e7-a064-e469e3a2c3d3/init-textfile/0.log"
Jul 16 18:57:39.368309 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.368258    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bf8kt_fd91a21c-0e28-472c-875f-c0f946eda1e4/kube-rbac-proxy-main/0.log"
Jul 16 18:57:39.395890 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.395849    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bf8kt_fd91a21c-0e28-472c-875f-c0f946eda1e4/kube-rbac-proxy-self/0.log"
Jul 16 18:57:39.420199 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.420170    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bf8kt_fd91a21c-0e28-472c-875f-c0f946eda1e4/openshift-state-metrics/0.log"
Jul 16 18:57:39.667006 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.666973    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-pkvsz_c476af21-df8b-4e97-9eac-68c9baae5469/prometheus-operator/0.log"
Jul 16 18:57:39.688441 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:39.688409    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-pkvsz_c476af21-df8b-4e97-9eac-68c9baae5469/kube-rbac-proxy/0.log"
Jul 16 18:57:41.505852 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:41.505815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-d57tx_8ed2a920-8597-4db3-90ed-efb54db7aa39/networking-console-plugin/0.log"
Jul 16 18:57:42.026023 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.025993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/1.log"
Jul 16 18:57:42.032658 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.032629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-nkbnv_a5cd749a-2e5b-44fd-9a81-441a951f9ee7/console-operator/2.log"
Jul 16 18:57:42.551125 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.551096    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-7jpdn_edfb7ce2-b7ee-4d33-a11f-2de7432de33a/download-server/0.log"
Jul 16 18:57:42.787386 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.787343    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"]
Jul 16 18:57:42.787984 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.787953    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69caef12-f159-43da-9382-97808a6931af" containerName="copy"
Jul 16 18:57:42.787984 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.787983    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="69caef12-f159-43da-9382-97808a6931af" containerName="copy"
Jul 16 18:57:42.788204 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.788021    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69caef12-f159-43da-9382-97808a6931af" containerName="gather"
Jul 16 18:57:42.788204 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.788034    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="69caef12-f159-43da-9382-97808a6931af" containerName="gather"
Jul 16 18:57:42.788204 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.788170    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="69caef12-f159-43da-9382-97808a6931af" containerName="gather"
Jul 16 18:57:42.788204 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.788187    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="69caef12-f159-43da-9382-97808a6931af" containerName="copy"
Jul 16 18:57:42.794361 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.794335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:42.800478 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.800441    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"]
Jul 16 18:57:42.924163 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.924133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-lib-modules\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:42.924342 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.924190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-podres\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:42.924342 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.924320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjf6\" (UniqueName: \"kubernetes.io/projected/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-kube-api-access-tmjf6\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:42.924426 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.924383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-proc\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:42.924461 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:42.924424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-sys\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.025718 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.025678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-podres\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.025910 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.025743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjf6\" (UniqueName: \"kubernetes.io/projected/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-kube-api-access-tmjf6\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.025910 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.025807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-proc\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.025910 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.025848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-sys\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.025910 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.025893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-lib-modules\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.026075 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.025925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-proc\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.026075 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.025993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-sys\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.026075 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.026012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-lib-modules\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.026217 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.026195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-podres\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.035614 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.035590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjf6\" (UniqueName: \"kubernetes.io/projected/d64c2065-f4a1-4344-a7fe-27ac7c9453f8-kube-api-access-tmjf6\") pod \"perf-node-gather-daemonset-8hcm5\" (UID: \"d64c2065-f4a1-4344-a7fe-27ac7c9453f8\") " pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.114887 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.114852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.279798 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.279753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"]
Jul 16 18:57:43.286787 ip-10-0-128-180 kubenswrapper[2580]: W0716 18:57:43.286751    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd64c2065_f4a1_4344_a7fe_27ac7c9453f8.slice/crio-4c4f7c1160415fca536a4a6641360c257cb0b30211014e4b0581d0d6f20208a5 WatchSource:0}: Error finding container 4c4f7c1160415fca536a4a6641360c257cb0b30211014e4b0581d0d6f20208a5: Status 404 returned error can't find the container with id 4c4f7c1160415fca536a4a6641360c257cb0b30211014e4b0581d0d6f20208a5
Jul 16 18:57:43.865248 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.865205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5" event={"ID":"d64c2065-f4a1-4344-a7fe-27ac7c9453f8","Type":"ContainerStarted","Data":"0823c34e8938ad536e5eca53dd9d12f3123a9b110f7fa6f76c4b75ece17ee3c1"}
Jul 16 18:57:43.865725 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.865291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5" event={"ID":"d64c2065-f4a1-4344-a7fe-27ac7c9453f8","Type":"ContainerStarted","Data":"4c4f7c1160415fca536a4a6641360c257cb0b30211014e4b0581d0d6f20208a5"}
Jul 16 18:57:43.865725 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.865712    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:43.885159 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:43.885099    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5" podStartSLOduration=1.885078622 podStartE2EDuration="1.885078622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:57:43.882021305 +0000 UTC m=+4972.518223274" watchObservedRunningTime="2026-07-16 18:57:43.885078622 +0000 UTC m=+4972.521280591"
Jul 16 18:57:44.208000 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:44.207906    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6j895_08642b6e-37f1-48e2-a82b-cb7b47fe3827/dns/0.log"
Jul 16 18:57:44.230240 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:44.230217    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6j895_08642b6e-37f1-48e2-a82b-cb7b47fe3827/kube-rbac-proxy/0.log"
Jul 16 18:57:44.382966 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:44.382937    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xkbj_b1b04fd5-0f3c-4280-bbe6-21eaa8f37067/dns-node-resolver/0.log"
Jul 16 18:57:45.005458 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:45.005428    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66695db459-q5zrn_c9e4b590-c5f8-4277-b6fe-6109f7287710/registry/0.log"
Jul 16 18:57:45.030960 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:45.030924    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f4wxn_2a4d2858-5981-43ea-bffa-97593ee9622d/node-ca/0.log"
Jul 16 18:57:46.427328 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:46.427298    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wnhkc_247c3d33-3bd8-4566-9752-08f0fd38caa4/discovery/0.log"
Jul 16 18:57:47.071707 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:47.071651    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mw7nr_9938b86a-7daa-49d8-b052-7d0d20ecf911/serve-healthcheck-canary/0.log"
Jul 16 18:57:47.717760 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:47.717727    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ftsqx_8fc36cf8-8882-48a3-b22a-4b671cab7694/kube-rbac-proxy/0.log"
Jul 16 18:57:47.744656 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:47.744627    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ftsqx_8fc36cf8-8882-48a3-b22a-4b671cab7694/exporter/0.log"
Jul 16 18:57:47.771188 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:47.771159    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ftsqx_8fc36cf8-8882-48a3-b22a-4b671cab7694/extractor/0.log"
Jul 16 18:57:49.881422 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:49.881393    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kt8tj/perf-node-gather-daemonset-8hcm5"
Jul 16 18:57:50.619972 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:50.619937    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2hxnc_204f0bcf-c289-467b-9d70-5faaa9667ad3/openshift-lws-operator/0.log"
Jul 16 18:57:51.274432 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:51.274402    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-576d7b7757-pddx2_221970bb-2c5a-436a-9ab7-ecd49a5d3a74/manager/0.log"
Jul 16 18:57:52.347466 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:52.347390    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-tnr46_82bbe50c-3fb4-4015-9820-0ab0596e3a3c/seaweedfs/0.log"
Jul 16 18:57:53.404843 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:53.404811    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wnhkc_247c3d33-3bd8-4566-9752-08f0fd38caa4/discovery/0.log"
Jul 16 18:57:54.846190 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:54.846095    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wnhkc_247c3d33-3bd8-4566-9752-08f0fd38caa4/discovery/0.log"
Jul 16 18:57:57.377379 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:57.377324    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5fthk_37e477e7-402f-44f7-b221-1293c68c88f1/migrator/0.log"
Jul 16 18:57:57.399270 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:57.399246    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5fthk_37e477e7-402f-44f7-b221-1293c68c88f1/graceful-termination/0.log"
Jul 16 18:57:57.767047 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:57.766976    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-lk6hb_fea963ca-8f54-4efb-ac8d-e68a31099d96/kube-storage-version-migrator-operator/1.log"
Jul 16 18:57:57.767723 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:57.767703    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-lk6hb_fea963ca-8f54-4efb-ac8d-e68a31099d96/kube-storage-version-migrator-operator/0.log"
Jul 16 18:57:58.743235 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:58.743208    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4flfv_49445d2d-147c-493c-8fcc-5fbe0687c337/kube-multus-additional-cni-plugins/0.log"
Jul 16 18:57:58.766242 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:58.766219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4flfv_49445d2d-147c-493c-8fcc-5fbe0687c337/egress-router-binary-copy/0.log"
Jul 16 18:57:58.787576 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:58.787552    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4flfv_49445d2d-147c-493c-8fcc-5fbe0687c337/cni-plugins/0.log"
Jul 16 18:57:58.809082 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:58.809061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4flfv_49445d2d-147c-493c-8fcc-5fbe0687c337/bond-cni-plugin/0.log"
Jul 16 18:57:58.833422 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:58.833398    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4flfv_49445d2d-147c-493c-8fcc-5fbe0687c337/routeoverride-cni/0.log"
Jul 16 18:57:58.854888 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:58.854868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4flfv_49445d2d-147c-493c-8fcc-5fbe0687c337/whereabouts-cni-bincopy/0.log"
Jul 16 18:57:58.876342 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:58.876324    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4flfv_49445d2d-147c-493c-8fcc-5fbe0687c337/whereabouts-cni/0.log"
Jul 16 18:57:59.242947 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:59.242916    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kjh44_e37dd5db-85ae-4f5d-bdd5-f4c81bc1e36f/kube-multus/0.log"
Jul 16 18:57:59.341742 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:59.341717    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5dnnt_b2cd0c26-0ee6-4e7b-a208-397602a25675/network-metrics-daemon/0.log"
Jul 16 18:57:59.363937 ip-10-0-128-180 kubenswrapper[2580]: I0716 18:57:59.363915    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5dnnt_b2cd0c26-0ee6-4e7b-a208-397602a25675/kube-rbac-proxy/0.log"